[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260503 07:56:16.432447 26792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.42.62:45539
I20260503 07:56:16.433840 26792 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260503 07:56:16.434870 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:16.450487 26799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:16.450718 26798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:16.452426 26792 server_base.cc:1061] running on GCE node
W20260503 07:56:16.450721 26801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:17.575181 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:17.575450 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:17.575668 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777794977575644 us; error 0 us; skew 500 ppm
I20260503 07:56:17.576509 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:17.581478 26792 webserver.cc:492] Webserver started at http://127.26.42.62:36315/ using document root <none> and password file <none>
I20260503 07:56:17.582301 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:17.582533 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:17.583016 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:17.588655 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/master-0-root/instance:
uuid: "0bca1d6f2f514c01af9a4aa1844369c7"
format_stamp: "Formatted at 2026-05-03 07:56:17 on dist-test-slave-pd7x"
I20260503 07:56:17.595526 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260503 07:56:17.600308 26807 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:17.601336 26792 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260503 07:56:17.601662 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/master-0-root
uuid: "0bca1d6f2f514c01af9a4aa1844369c7"
format_stamp: "Formatted at 2026-05-03 07:56:17 on dist-test-slave-pd7x"
I20260503 07:56:17.602018 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:17.648785 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:17.650157 26792 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260503 07:56:17.650560 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:17.716068 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.62:45539
I20260503 07:56:17.716135 26858 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.62:45539 every 8 connection(s)
I20260503 07:56:17.723316 26859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:17.743573 26859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7: Bootstrap starting.
I20260503 07:56:17.749361 26859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:17.750993 26859 log.cc:826] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7: Log is configured to *not* fsync() on all Append() calls
I20260503 07:56:17.755676 26859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7: No bootstrap required, opened a new log
I20260503 07:56:17.775743 26859 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" member_type: VOTER }
I20260503 07:56:17.776188 26859 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:17.776371 26859 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bca1d6f2f514c01af9a4aa1844369c7, State: Initialized, Role: FOLLOWER
I20260503 07:56:17.777112 26859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" member_type: VOTER }
I20260503 07:56:17.777554 26859 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260503 07:56:17.777774 26859 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260503 07:56:17.778038 26859 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:17.781760 26859 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" member_type: VOTER }
I20260503 07:56:17.782357 26859 leader_election.cc:304] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bca1d6f2f514c01af9a4aa1844369c7; no voters:
I20260503 07:56:17.783797 26859 leader_election.cc:290] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260503 07:56:17.784088 26862 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:17.786275 26862 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 1 LEADER]: Becoming Leader. State: Replica: 0bca1d6f2f514c01af9a4aa1844369c7, State: Running, Role: LEADER
I20260503 07:56:17.787071 26862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" member_type: VOTER }
I20260503 07:56:17.787976 26859 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260503 07:56:17.798065 26863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" member_type: VOTER } }
I20260503 07:56:17.798197 26864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bca1d6f2f514c01af9a4aa1844369c7. Latest consensus state: current_term: 1 leader_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bca1d6f2f514c01af9a4aa1844369c7" member_type: VOTER } }
I20260503 07:56:17.798780 26863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [sys.catalog]: This master's current role is: LEADER
I20260503 07:56:17.798902 26864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [sys.catalog]: This master's current role is: LEADER
I20260503 07:56:17.801213 26872 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260503 07:56:17.811990 26872 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260503 07:56:17.814210 26792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260503 07:56:17.828784 26872 catalog_manager.cc:1357] Generated new cluster ID: 40fe1966f9d44374b44593ec8a4c726c
I20260503 07:56:17.829035 26872 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260503 07:56:17.851922 26872 catalog_manager.cc:1380] Generated new certificate authority record
I20260503 07:56:17.853338 26872 catalog_manager.cc:1514] Loading token signing keys...
I20260503 07:56:17.865934 26872 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7: Generated new TSK 0
I20260503 07:56:17.866714 26872 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260503 07:56:17.880252 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:17.888298 26881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:17.890108 26882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:17.893209 26884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:17.893347 26792 server_base.cc:1061] running on GCE node
I20260503 07:56:17.894109 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:17.894289 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:17.894481 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777794977894469 us; error 0 us; skew 500 ppm
I20260503 07:56:17.895074 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:17.898723 26792 webserver.cc:492] Webserver started at http://127.26.42.1:36543/ using document root <none> and password file <none>
I20260503 07:56:17.899302 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:17.899497 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:17.899828 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:17.901139 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-0-root/instance:
uuid: "53f788d4fc9449789bcb3a04afde68fc"
format_stamp: "Formatted at 2026-05-03 07:56:17 on dist-test-slave-pd7x"
I20260503 07:56:17.906579 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260503 07:56:17.910861 26889 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:17.911662 26792 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260503 07:56:17.911942 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-0-root
uuid: "53f788d4fc9449789bcb3a04afde68fc"
format_stamp: "Formatted at 2026-05-03 07:56:17 on dist-test-slave-pd7x"
I20260503 07:56:17.912186 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:17.932051 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:17.933318 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:17.936108 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:56:17.940373 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:56:17.940569 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:17.940894 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:56:17.941099 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260503 07:56:18.038197 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.1:41943
I20260503 07:56:18.038285 26951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.1:41943 every 8 connection(s)
I20260503 07:56:18.044942 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:18.054198 26956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:18.061570 26957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:18.067205 26959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:18.067420 26792 server_base.cc:1061] running on GCE node
I20260503 07:56:18.068188 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:18.068398 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:18.068632 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777794978068591 us; error 0 us; skew 500 ppm
I20260503 07:56:18.069518 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:18.076372 26952 heartbeater.cc:344] Connected to a master server at 127.26.42.62:45539
I20260503 07:56:18.076807 26952 heartbeater.cc:461] Registering TS with master...
I20260503 07:56:18.077824 26952 heartbeater.cc:507] Master 127.26.42.62:45539 requested a full tablet report, sending...
I20260503 07:56:18.081131 26824 ts_manager.cc:194] Registered new tserver with Master: 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943)
I20260503 07:56:18.083877 26824 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44586
I20260503 07:56:18.084865 26792 webserver.cc:492] Webserver started at http://127.26.42.2:42719/ using document root <none> and password file <none>
I20260503 07:56:18.085616 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:18.085891 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:18.086215 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:18.087430 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-1-root/instance:
uuid: "0b67137972744d32ac88241d9e68fd52"
format_stamp: "Formatted at 2026-05-03 07:56:18 on dist-test-slave-pd7x"
I20260503 07:56:18.092672 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260503 07:56:18.096506 26964 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:18.097280 26792 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260503 07:56:18.097527 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-1-root
uuid: "0b67137972744d32ac88241d9e68fd52"
format_stamp: "Formatted at 2026-05-03 07:56:18 on dist-test-slave-pd7x"
I20260503 07:56:18.097780 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:18.122509 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:18.123685 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:18.125777 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:56:18.128998 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:56:18.129290 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:18.129550 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:56:18.129715 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:18.228928 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.2:44111
I20260503 07:56:18.229115 27026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.2:44111 every 8 connection(s)
I20260503 07:56:18.235931 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:18.246927 27030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:18.254071 27031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:18.257560 27027 heartbeater.cc:344] Connected to a master server at 127.26.42.62:45539
I20260503 07:56:18.258013 27027 heartbeater.cc:461] Registering TS with master...
I20260503 07:56:18.259127 27027 heartbeater.cc:507] Master 127.26.42.62:45539 requested a full tablet report, sending...
I20260503 07:56:18.261710 26824 ts_manager.cc:194] Registered new tserver with Master: 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
W20260503 07:56:18.263566 27033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:18.263645 26824 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44602
I20260503 07:56:18.266309 26792 server_base.cc:1061] running on GCE node
I20260503 07:56:18.267117 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:18.267319 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:18.267489 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777794978267473 us; error 0 us; skew 500 ppm
I20260503 07:56:18.268026 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:18.270565 26792 webserver.cc:492] Webserver started at http://127.26.42.3:34537/ using document root <none> and password file <none>
I20260503 07:56:18.271016 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:18.271229 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:18.271471 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:18.272403 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-2-root/instance:
uuid: "9282b76d980744839836fb69867fa36e"
format_stamp: "Formatted at 2026-05-03 07:56:18 on dist-test-slave-pd7x"
I20260503 07:56:18.277100 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260503 07:56:18.281054 27038 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:18.281986 26792 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260503 07:56:18.282356 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-2-root
uuid: "9282b76d980744839836fb69867fa36e"
format_stamp: "Formatted at 2026-05-03 07:56:18 on dist-test-slave-pd7x"
I20260503 07:56:18.282722 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1777794976273375-26792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:18.306339 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:18.307497 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:18.308900 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:56:18.310855 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:56:18.311017 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:18.311278 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:56:18.311406 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:18.404578 27100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.3:36553 every 8 connection(s)
I20260503 07:56:18.404526 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.3:36553
I20260503 07:56:18.421716 27101 heartbeater.cc:344] Connected to a master server at 127.26.42.62:45539
I20260503 07:56:18.422041 27101 heartbeater.cc:461] Registering TS with master...
I20260503 07:56:18.422727 27101 heartbeater.cc:507] Master 127.26.42.62:45539 requested a full tablet report, sending...
I20260503 07:56:18.424333 26824 ts_manager.cc:194] Registered new tserver with Master: 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:18.424978 26792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013312055s
I20260503 07:56:18.425940 26824 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44616
I20260503 07:56:18.469745 26824 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44628:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:56:18.473160 26824 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:56:18.570861 26992 tablet_service.cc:1511] Processing CreateTablet for tablet facee198c7534df99001437eeef1aba7 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260503 07:56:18.572376 26992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facee198c7534df99001437eeef1aba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.578744 26917 tablet_service.cc:1511] Processing CreateTablet for tablet facee198c7534df99001437eeef1aba7 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260503 07:56:18.580049 26917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facee198c7534df99001437eeef1aba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.581542 26914 tablet_service.cc:1511] Processing CreateTablet for tablet e1cafd79812940b19b75935e08f91db1 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260503 07:56:18.582836 26914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1cafd79812940b19b75935e08f91db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.586135 26915 tablet_service.cc:1511] Processing CreateTablet for tablet f127b74b0daf4769b1038bb0ca8a44cd (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260503 07:56:18.587391 26915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f127b74b0daf4769b1038bb0ca8a44cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.589794 26916 tablet_service.cc:1511] Processing CreateTablet for tablet 9daa0a2d774f4cfc92815a8680401e63 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260503 07:56:18.590898 26916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9daa0a2d774f4cfc92815a8680401e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.609753 26910 tablet_service.cc:1511] Processing CreateTablet for tablet 3109ae7ea47448088ea4269d5c9f0acb (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260503 07:56:18.604357 26912 tablet_service.cc:1511] Processing CreateTablet for tablet ca07b0ba1a944c15bf1efed6e91347de (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260503 07:56:18.611816 26910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3109ae7ea47448088ea4269d5c9f0acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.613508 26909 tablet_service.cc:1511] Processing CreateTablet for tablet 62378012bc404711865789d9bd2c95c6 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260503 07:56:18.614277 26912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca07b0ba1a944c15bf1efed6e91347de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.613551 26913 tablet_service.cc:1511] Processing CreateTablet for tablet 47a1ffbac5ab40c8a713020dc7e06abb (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260503 07:56:18.610702 26991 tablet_service.cc:1511] Processing CreateTablet for tablet 9daa0a2d774f4cfc92815a8680401e63 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260503 07:56:18.624620 26909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62378012bc404711865789d9bd2c95c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.626384 26987 tablet_service.cc:1511] Processing CreateTablet for tablet ca07b0ba1a944c15bf1efed6e91347de (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260503 07:56:18.625046 26989 tablet_service.cc:1511] Processing CreateTablet for tablet e1cafd79812940b19b75935e08f91db1 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260503 07:56:18.624680 26988 tablet_service.cc:1511] Processing CreateTablet for tablet 47a1ffbac5ab40c8a713020dc7e06abb (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260503 07:56:18.633527 26991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9daa0a2d774f4cfc92815a8680401e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.625519 26911 tablet_service.cc:1511] Processing CreateTablet for tablet 479a0006f2524001b238124d35b7fb6b (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260503 07:56:18.636353 26913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a1ffbac5ab40c8a713020dc7e06abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.636570 26987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca07b0ba1a944c15bf1efed6e91347de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.628470 26990 tablet_service.cc:1511] Processing CreateTablet for tablet f127b74b0daf4769b1038bb0ca8a44cd (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260503 07:56:18.639911 26986 tablet_service.cc:1511] Processing CreateTablet for tablet 479a0006f2524001b238124d35b7fb6b (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260503 07:56:18.642328 26985 tablet_service.cc:1511] Processing CreateTablet for tablet 62378012bc404711865789d9bd2c95c6 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260503 07:56:18.650139 26911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479a0006f2524001b238124d35b7fb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.649142 26989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1cafd79812940b19b75935e08f91db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.643054 26984 tablet_service.cc:1511] Processing CreateTablet for tablet 3109ae7ea47448088ea4269d5c9f0acb (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260503 07:56:18.653673 26990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f127b74b0daf4769b1038bb0ca8a44cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.655314 26988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a1ffbac5ab40c8a713020dc7e06abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.656445 26984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3109ae7ea47448088ea4269d5c9f0acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.668805 26986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479a0006f2524001b238124d35b7fb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.673709 26985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62378012bc404711865789d9bd2c95c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.728731 27118 tablet_bootstrap.cc:492] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:18.737336 27119 tablet_bootstrap.cc:492] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:18.748629 27066 tablet_service.cc:1511] Processing CreateTablet for tablet facee198c7534df99001437eeef1aba7 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260503 07:56:18.755031 27064 tablet_service.cc:1511] Processing CreateTablet for tablet f127b74b0daf4769b1038bb0ca8a44cd (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260503 07:56:18.764333 27060 tablet_service.cc:1511] Processing CreateTablet for tablet 479a0006f2524001b238124d35b7fb6b (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260503 07:56:18.760921 27065 tablet_service.cc:1511] Processing CreateTablet for tablet 9daa0a2d774f4cfc92815a8680401e63 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260503 07:56:18.773872 27062 tablet_service.cc:1511] Processing CreateTablet for tablet 47a1ffbac5ab40c8a713020dc7e06abb (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260503 07:56:18.769320 27059 tablet_service.cc:1511] Processing CreateTablet for tablet 3109ae7ea47448088ea4269d5c9f0acb (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260503 07:56:18.776008 27058 tablet_service.cc:1511] Processing CreateTablet for tablet 62378012bc404711865789d9bd2c95c6 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260503 07:56:18.777415 27061 tablet_service.cc:1511] Processing CreateTablet for tablet ca07b0ba1a944c15bf1efed6e91347de (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260503 07:56:18.779824 27066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facee198c7534df99001437eeef1aba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.760802 27063 tablet_service.cc:1511] Processing CreateTablet for tablet e1cafd79812940b19b75935e08f91db1 (DEFAULT_TABLE table=test-workload [id=475f715dc5614dcfa66585d5996face6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260503 07:56:18.782807 27060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479a0006f2524001b238124d35b7fb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.784690 27058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62378012bc404711865789d9bd2c95c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.786525 27065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9daa0a2d774f4cfc92815a8680401e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.788861 27062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a1ffbac5ab40c8a713020dc7e06abb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:56:18.824374 26871 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:56:18.828301 27064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f127b74b0daf4769b1038bb0ca8a44cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.830295 27059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3109ae7ea47448088ea4269d5c9f0acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.841270 27063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1cafd79812940b19b75935e08f91db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.853615 27061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca07b0ba1a944c15bf1efed6e91347de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:18.884404 27118 tablet_bootstrap.cc:654] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:18.899998 27119 tablet_bootstrap.cc:654] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:18.949679 27118 tablet_bootstrap.cc:492] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:18.950131 27118 ts_tablet_manager.cc:1403] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.310s user 0.009s sys 0.011s
I20260503 07:56:18.953912 27119 tablet_bootstrap.cc:492] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:18.954319 27119 ts_tablet_manager.cc:1403] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.218s user 0.017s sys 0.018s
I20260503 07:56:18.958554 27118 raft_consensus.cc:359] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:18.959292 27118 raft_consensus.cc:385] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:18.959173 27119 raft_consensus.cc:359] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:18.960078 27118 raft_consensus.cc:740] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:18.960496 27119 raft_consensus.cc:385] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:18.960973 27119 raft_consensus.cc:740] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:18.960866 27118 consensus_queue.cc:260] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:18.963963 27119 consensus_queue.cc:260] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:18.964598 27122 tablet_bootstrap.cc:492] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:18.971396 26952 heartbeater.cc:499] Master 127.26.42.62:45539 was elected leader, sending a full tablet report...
I20260503 07:56:18.972134 27122 tablet_bootstrap.cc:654] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:18.972332 27118 ts_tablet_manager.cc:1434] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.022s user 0.006s sys 0.007s
I20260503 07:56:18.973299 27118 tablet_bootstrap.cc:492] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:18.980504 27118 tablet_bootstrap.cc:654] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:18.982208 27027 heartbeater.cc:499] Master 127.26.42.62:45539 was elected leader, sending a full tablet report...
I20260503 07:56:18.993134 27122 tablet_bootstrap.cc:492] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:18.993582 27122 ts_tablet_manager.cc:1403] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.040s user 0.016s sys 0.013s
I20260503 07:56:18.996236 27123 raft_consensus.cc:493] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:18.996469 27122 raft_consensus.cc:359] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:18.996631 27123 raft_consensus.cc:515] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:18.997129 27122 raft_consensus.cc:385] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:18.997440 27122 raft_consensus.cc:740] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:18.998073 27122 consensus_queue.cc:260] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:18.999351 27123 leader_election.cc:290] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:18.995908 27118 tablet_bootstrap.cc:492] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.000327 27118 ts_tablet_manager.cc:1403] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.004s
I20260503 07:56:19.003675 27118 raft_consensus.cc:359] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.004546 27118 raft_consensus.cc:385] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.004943 27118 raft_consensus.cc:740] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.005693 27118 consensus_queue.cc:260] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.006531 27101 heartbeater.cc:499] Master 127.26.42.62:45539 was elected leader, sending a full tablet report...
I20260503 07:56:19.007484 27122 ts_tablet_manager.cc:1434] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260503 07:56:19.007824 27118 ts_tablet_manager.cc:1434] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260503 07:56:19.008709 27118 tablet_bootstrap.cc:492] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:19.008783 27122 tablet_bootstrap.cc:492] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.011778 27119 ts_tablet_manager.cc:1434] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.057s user 0.008s sys 0.005s
I20260503 07:56:19.013875 27119 tablet_bootstrap.cc:492] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.014946 27118 tablet_bootstrap.cc:654] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.016661 27122 tablet_bootstrap.cc:654] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.022086 27124 raft_consensus.cc:493] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.022498 27124 raft_consensus.cc:515] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:19.025434 27124 leader_election.cc:290] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9282b76d980744839836fb69867fa36e (127.26.42.3:36553), 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943)
I20260503 07:56:19.034971 27119 tablet_bootstrap.cc:654] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
W20260503 07:56:19.067155 26953 tablet.cc:2404] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 07:56:19.068390 27119 tablet_bootstrap.cc:492] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.068898 27119 ts_tablet_manager.cc:1403] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.055s user 0.015s sys 0.006s
I20260503 07:56:19.073909 27119 raft_consensus.cc:359] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.078621 27119 raft_consensus.cc:385] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.078985 27119 raft_consensus.cc:740] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.079810 27119 consensus_queue.cc:260] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.085136 27119 ts_tablet_manager.cc:1434] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.014s user 0.008s sys 0.000s
I20260503 07:56:19.087625 27118 tablet_bootstrap.cc:492] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.088165 27118 ts_tablet_manager.cc:1403] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.080s user 0.015s sys 0.020s
I20260503 07:56:19.091163 27118 raft_consensus.cc:359] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.091845 27118 raft_consensus.cc:385] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.092111 27118 raft_consensus.cc:740] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.092731 27118 consensus_queue.cc:260] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.094025 27119 tablet_bootstrap.cc:492] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.102509 27118 ts_tablet_manager.cc:1434] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260503 07:56:19.103621 27118 tablet_bootstrap.cc:492] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:19.104492 27123 raft_consensus.cc:493] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.105309 27123 raft_consensus.cc:515] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.107291 27123 leader_election.cc:290] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.113106 27119 tablet_bootstrap.cc:654] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.119045 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.120620 27002 raft_consensus.cc:2468] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 0.
I20260503 07:56:19.122020 27118 tablet_bootstrap.cc:654] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.121560 27122 tablet_bootstrap.cc:492] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.119817 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e" is_pre_election: true
I20260503 07:56:19.122807 27122 ts_tablet_manager.cc:1403] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.114s user 0.019s sys 0.034s
I20260503 07:56:19.121882 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.124404 26890 leader_election.cc:304] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
W20260503 07:56:19.124881 26965 leader_election.cc:343] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.125630 27123 raft_consensus.cc:2804] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260503 07:56:19.125784 26890 leader_election.cc:343] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.125986 27123 raft_consensus.cc:493] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.126324 27123 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.137665 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.139101 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e" is_pre_election: true
I20260503 07:56:19.139061 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e" is_pre_election: true
I20260503 07:56:19.139902 27123 raft_consensus.cc:515] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
W20260503 07:56:19.140427 26890 leader_election.cc:343] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.140964 26927 raft_consensus.cc:2393] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0b67137972744d32ac88241d9e68fd52 in current term 1: Already voted for candidate 53f788d4fc9449789bcb3a04afde68fc in this term.
W20260503 07:56:19.141525 26890 leader_election.cc:343] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.141885 26890 leader_election.cc:304] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc; no voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e
I20260503 07:56:19.142218 27122 raft_consensus.cc:359] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.143535 27122 raft_consensus.cc:385] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.144035 27124 raft_consensus.cc:493] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.144567 27124 raft_consensus.cc:515] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.147401 26968 leader_election.cc:304] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52; no voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e
I20260503 07:56:19.149411 27119 tablet_bootstrap.cc:492] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.150036 27119 ts_tablet_manager.cc:1403] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.056s user 0.013s sys 0.011s
I20260503 07:56:19.150295 27123 leader_election.cc:290] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.150441 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e" is_pre_election: true
I20260503 07:56:19.150758 27123 raft_consensus.cc:2749] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:56:19.151584 26965 leader_election.cc:343] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.149250 27124 leader_election.cc:290] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.154017 27124 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.157382 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e"
W20260503 07:56:19.158659 26890 leader_election.cc:343] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.158881 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
W20260503 07:56:19.160238 26968 leader_election.cc:343] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.160351 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.160676 26968 leader_election.cc:304] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52; no voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e
I20260503 07:56:19.143843 27122 raft_consensus.cc:740] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.161196 27124 raft_consensus.cc:2749] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:56:19.161602 27119 raft_consensus.cc:359] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.162847 27138 raft_consensus.cc:2749] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:56:19.162945 27122 consensus_queue.cc:260] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.166520 27118 tablet_bootstrap.cc:492] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.166917 27118 ts_tablet_manager.cc:1403] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.064s user 0.012s sys 0.001s
I20260503 07:56:19.168563 27122 ts_tablet_manager.cc:1434] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.045s user 0.003s sys 0.003s
I20260503 07:56:19.169427 27122 tablet_bootstrap.cc:492] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.169512 27118 raft_consensus.cc:359] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.170176 27118 raft_consensus.cc:385] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.170217 27001 raft_consensus.cc:2468] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 1.
I20260503 07:56:19.170488 27118 raft_consensus.cc:740] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.171247 27118 consensus_queue.cc:260] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.172029 26890 leader_election.cc:304] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters: 9282b76d980744839836fb69867fa36e
I20260503 07:56:19.172976 27123 raft_consensus.cc:2804] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.173350 27118 ts_tablet_manager.cc:1434] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260503 07:56:19.173431 27123 raft_consensus.cc:697] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:19.174345 27118 tablet_bootstrap.cc:492] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:19.174317 27123 consensus_queue.cc:237] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:19.181424 27118 tablet_bootstrap.cc:654] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.164175 27119 raft_consensus.cc:385] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.183907 27119 raft_consensus.cc:740] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.184652 27119 consensus_queue.cc:260] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.187163 27119 ts_tablet_manager.cc:1434] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.037s user 0.005s sys 0.000s
I20260503 07:56:19.190083 26824 catalog_manager.cc:5671] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 1 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:19.192217 27119 tablet_bootstrap.cc:492] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.196108 27122 tablet_bootstrap.cc:654] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.200599 27118 tablet_bootstrap.cc:492] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.202296 27118 ts_tablet_manager.cc:1403] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.008s
I20260503 07:56:19.205236 27119 tablet_bootstrap.cc:654] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.205502 27118 raft_consensus.cc:359] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.206676 27118 raft_consensus.cc:385] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.206979 27118 raft_consensus.cc:740] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.207597 27118 consensus_queue.cc:260] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.212234 27118 ts_tablet_manager.cc:1434] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260503 07:56:19.213119 27118 tablet_bootstrap.cc:492] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:19.223371 27122 tablet_bootstrap.cc:492] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.223788 27122 ts_tablet_manager.cc:1403] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.055s user 0.005s sys 0.007s
I20260503 07:56:19.224193 27118 tablet_bootstrap.cc:654] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.225275 27119 tablet_bootstrap.cc:492] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.225854 27119 ts_tablet_manager.cc:1403] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.009s
I20260503 07:56:19.227033 27122 raft_consensus.cc:359] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.227839 27122 raft_consensus.cc:385] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.228190 27122 raft_consensus.cc:740] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.228811 27119 raft_consensus.cc:359] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.229773 27119 raft_consensus.cc:385] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.229162 27122 consensus_queue.cc:260] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.230563 27119 raft_consensus.cc:740] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.231552 27119 consensus_queue.cc:260] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.241091 27122 ts_tablet_manager.cc:1434] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.017s user 0.010s sys 0.000s
I20260503 07:56:19.242983 27119 ts_tablet_manager.cc:1434] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20260503 07:56:19.246718 27119 tablet_bootstrap.cc:492] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.252797 27122 tablet_bootstrap.cc:492] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.253173 27118 tablet_bootstrap.cc:492] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.254240 27118 ts_tablet_manager.cc:1403] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.041s user 0.017s sys 0.019s
I20260503 07:56:19.253309 27119 tablet_bootstrap.cc:654] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.261694 27122 tablet_bootstrap.cc:654] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.262809 27118 raft_consensus.cc:359] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.263538 27118 raft_consensus.cc:385] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.263824 27118 raft_consensus.cc:740] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.264499 27118 consensus_queue.cc:260] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.266835 27118 ts_tablet_manager.cc:1434] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260503 07:56:19.267637 27118 tablet_bootstrap.cc:492] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:19.270094 27123 raft_consensus.cc:493] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.270496 27123 raft_consensus.cc:515] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.272593 27123 leader_election.cc:290] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.273865 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.274441 27001 raft_consensus.cc:2468] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 0.
I20260503 07:56:19.275378 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e" is_pre_election: true
I20260503 07:56:19.276808 26890 leader_election.cc:304] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:19.277472 27123 raft_consensus.cc:2804] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260503 07:56:19.277580 26890 leader_election.cc:343] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.277782 27123 raft_consensus.cc:493] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.278105 27123 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.278498 27119 tablet_bootstrap.cc:492] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.279335 27119 ts_tablet_manager.cc:1403] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.001s
I20260503 07:56:19.282006 27119 raft_consensus.cc:359] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.282657 27119 raft_consensus.cc:385] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.282924 27119 raft_consensus.cc:740] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.283573 27119 consensus_queue.cc:260] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.284739 27123 raft_consensus.cc:515] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.286542 27119 ts_tablet_manager.cc:1434] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260503 07:56:19.286988 27123 leader_election.cc:290] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.277226 27118 tablet_bootstrap.cc:654] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.287392 27119 tablet_bootstrap.cc:492] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.288090 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e"
W20260503 07:56:19.289502 26890 leader_election.cc:343] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.290447 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.290886 27001 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.295373 27119 tablet_bootstrap.cc:654] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.295946 27127 raft_consensus.cc:493] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.296126 27001 raft_consensus.cc:2468] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 1.
I20260503 07:56:19.296394 27127 raft_consensus.cc:515] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.297060 26890 leader_election.cc:304] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters: 9282b76d980744839836fb69867fa36e
I20260503 07:56:19.297694 27123 raft_consensus.cc:2804] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.298108 27123 raft_consensus.cc:697] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:19.298692 27127 leader_election.cc:290] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.298889 27123 consensus_queue.cc:237] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.297402 27118 tablet_bootstrap.cc:492] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.305225 27118 ts_tablet_manager.cc:1403] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.038s user 0.014s sys 0.000s
I20260503 07:56:19.308198 27118 raft_consensus.cc:359] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.308847 27118 raft_consensus.cc:385] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.309167 27118 raft_consensus.cc:740] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.309772 27118 consensus_queue.cc:260] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.312041 27118 ts_tablet_manager.cc:1434] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260503 07:56:19.315657 27122 tablet_bootstrap.cc:492] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.316198 27122 ts_tablet_manager.cc:1403] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.064s user 0.012s sys 0.011s
I20260503 07:56:19.321668 27118 tablet_bootstrap.cc:492] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:19.336416 27122 raft_consensus.cc:359] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.337955 27122 raft_consensus.cc:385] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.338460 27137 raft_consensus.cc:493] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.339077 27137 raft_consensus.cc:515] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.338485 27122 raft_consensus.cc:740] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.340828 27122 consensus_queue.cc:260] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.342401 27137 leader_election.cc:290] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.344161 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.352649 27001 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 0.
I20260503 07:56:19.344873 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e" is_pre_election: true
I20260503 07:56:19.355935 26890 leader_election.cc:304] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
W20260503 07:56:19.357172 26890 leader_election.cc:343] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.357455 27137 raft_consensus.cc:2804] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:19.357812 27137 raft_consensus.cc:493] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.358206 27137 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.359429 27122 ts_tablet_manager.cc:1434] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.043s user 0.005s sys 0.007s
I20260503 07:56:19.362113 27122 tablet_bootstrap.cc:492] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.366840 27119 tablet_bootstrap.cc:492] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.367318 27119 ts_tablet_manager.cc:1403] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.080s user 0.009s sys 0.006s
I20260503 07:56:19.374620 27137 raft_consensus.cc:515] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.375065 26824 catalog_manager.cc:5671] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 1 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:19.377956 27119 raft_consensus.cc:359] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.378621 27119 raft_consensus.cc:385] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.378897 27119 raft_consensus.cc:740] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.379529 27119 consensus_queue.cc:260] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.384799 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.385130 27118 tablet_bootstrap.cc:654] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.385438 27001 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.392879 27122 tablet_bootstrap.cc:654] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.391974 27119 ts_tablet_manager.cc:1434] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.024s user 0.006s sys 0.003s
I20260503 07:56:19.391010 27137 leader_election.cc:290] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.396165 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:19.396974 27118 tablet_bootstrap.cc:492] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.397413 27118 ts_tablet_manager.cc:1403] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.085s user 0.017s sys 0.001s
W20260503 07:56:19.397487 26890 leader_election.cc:343] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:19.398169 27001 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 1.
I20260503 07:56:19.399246 27119 tablet_bootstrap.cc:492] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.401791 27118 raft_consensus.cc:359] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.402447 27118 raft_consensus.cc:385] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.402748 27118 raft_consensus.cc:740] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.403333 27118 consensus_queue.cc:260] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.400256 26890 leader_election.cc:304] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters: 9282b76d980744839836fb69867fa36e
I20260503 07:56:19.405520 27118 ts_tablet_manager.cc:1434] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260503 07:56:19.405784 27123 raft_consensus.cc:2804] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.406260 27123 raft_consensus.cc:697] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:19.406488 27118 tablet_bootstrap.cc:492] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc: Bootstrap starting.
I20260503 07:56:19.406987 27123 consensus_queue.cc:237] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.412834 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.413739 26927 raft_consensus.cc:2468] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.415486 27042 leader_election.cc:304] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.416203 27127 raft_consensus.cc:2804] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:19.416571 27127 raft_consensus.cc:493] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.416847 27127 raft_consensus.cc:3060] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.430766 27118 tablet_bootstrap.cc:654] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.437294 27127 raft_consensus.cc:515] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.440333 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:19.441048 26927 raft_consensus.cc:3060] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.440649 27127 leader_election.cc:290] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.446540 27119 tablet_bootstrap.cc:654] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.451598 27122 tablet_bootstrap.cc:492] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.452039 27122 ts_tablet_manager.cc:1403] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.090s user 0.007s sys 0.012s
I20260503 07:56:19.454545 27122 raft_consensus.cc:359] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.455147 27122 raft_consensus.cc:385] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.455400 27122 raft_consensus.cc:740] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.455926 26927 raft_consensus.cc:2468] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.457782 27042 leader_election.cc:304] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.456005 27122 consensus_queue.cc:260] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.459523 27127 raft_consensus.cc:2804] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.459906 27127 raft_consensus.cc:697] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:19.460263 27122 ts_tablet_manager.cc:1434] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260503 07:56:19.460559 27118 tablet_bootstrap.cc:492] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc: No bootstrap required, opened a new log
I20260503 07:56:19.461045 27118 ts_tablet_manager.cc:1403] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc: Time spent bootstrapping tablet: real 0.055s user 0.010s sys 0.022s
I20260503 07:56:19.460597 27127 consensus_queue.cc:237] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.461199 27122 tablet_bootstrap.cc:492] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.464112 27118 raft_consensus.cc:359] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.464664 27118 raft_consensus.cc:385] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.464946 27118 raft_consensus.cc:740] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.465521 27118 consensus_queue.cc:260] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.467460 27118 ts_tablet_manager.cc:1434] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260503 07:56:19.466743 26824 catalog_manager.cc:5671] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 1 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:19.469607 27122 tablet_bootstrap.cc:654] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.475639 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.476258 27001 raft_consensus.cc:2468] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.477072 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.477552 27002 raft_consensus.cc:3060] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.486857 27002 raft_consensus.cc:2468] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.492271 27119 tablet_bootstrap.cc:492] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.492795 27119 ts_tablet_manager.cc:1403] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.094s user 0.009s sys 0.001s
I20260503 07:56:19.506108 27119 raft_consensus.cc:359] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.506984 27119 raft_consensus.cc:385] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.507350 27119 raft_consensus.cc:740] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.508011 27160 raft_consensus.cc:493] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.511317 27160 raft_consensus.cc:515] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.514751 26824 catalog_manager.cc:5671] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 1 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:19.515422 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.516103 27122 tablet_bootstrap.cc:492] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.516024 26927 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.516505 27122 ts_tablet_manager.cc:1403] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.056s user 0.016s sys 0.032s
I20260503 07:56:19.517174 27042 leader_election.cc:304] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.519169 27122 raft_consensus.cc:359] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.519343 27119 consensus_queue.cc:260] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.519901 27122 raft_consensus.cc:385] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.520169 27122 raft_consensus.cc:740] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.521147 27127 raft_consensus.cc:2804] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:19.521366 27119 ts_tablet_manager.cc:1434] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260503 07:56:19.521466 27127 raft_consensus.cc:493] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.521808 27127 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.520818 27122 consensus_queue.cc:260] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.527989 27160 leader_election.cc:290] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.528195 27127 raft_consensus.cc:515] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.529670 27119 tablet_bootstrap.cc:492] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.529922 27127 leader_election.cc:290] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.530278 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.530740 27002 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.532310 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.532688 27002 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.536398 27119 tablet_bootstrap.cc:654] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.536779 27002 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.537789 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:19.538779 26927 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.539479 27122 ts_tablet_manager.cc:1434] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.023s user 0.002s sys 0.011s
I20260503 07:56:19.540338 27122 tablet_bootstrap.cc:492] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.543329 26927 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.544581 27039 leader_election.cc:304] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.545898 27160 raft_consensus.cc:2804] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.546347 27160 raft_consensus.cc:697] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:19.546738 27122 tablet_bootstrap.cc:654] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.548141 27160 consensus_queue.cc:237] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.550940 27119 tablet_bootstrap.cc:492] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.551321 27119 ts_tablet_manager.cc:1403] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.005s
I20260503 07:56:19.554863 27119 raft_consensus.cc:359] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.555717 27119 raft_consensus.cc:385] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.556064 27119 raft_consensus.cc:740] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.556717 27119 consensus_queue.cc:260] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.558998 27119 ts_tablet_manager.cc:1434] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:56:19.560715 27119 tablet_bootstrap.cc:492] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52: Bootstrap starting.
I20260503 07:56:19.563582 27123 consensus_queue.cc:1048] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.566672 27122 tablet_bootstrap.cc:492] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.567185 27122 ts_tablet_manager.cc:1403] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.027s user 0.019s sys 0.000s
I20260503 07:56:19.566505 26824 catalog_manager.cc:5671] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 1 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:19.570502 27122 raft_consensus.cc:359] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.571199 27122 raft_consensus.cc:385] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.571524 27122 raft_consensus.cc:740] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.572144 27122 consensus_queue.cc:260] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.574498 27122 ts_tablet_manager.cc:1434] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:56:19.574554 27160 raft_consensus.cc:493] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.575037 27160 raft_consensus.cc:515] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.575475 27122 tablet_bootstrap.cc:492] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.577525 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.578264 26927 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.578560 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.579394 27042 leader_election.cc:304] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.579152 27001 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.579998 27127 raft_consensus.cc:2804] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:19.580325 27127 raft_consensus.cc:493] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.580615 27127 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.583141 27119 tablet_bootstrap.cc:654] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.583349 27160 leader_election.cc:290] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.587507 27127 raft_consensus.cc:515] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.589920 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:19.590425 26927 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.590860 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.591333 27001 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.595322 27119 tablet_bootstrap.cc:492] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52: No bootstrap required, opened a new log
I20260503 07:56:19.595642 27119 ts_tablet_manager.cc:1403] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.004s
I20260503 07:56:19.593498 27127 leader_election.cc:290] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.603207 27122 tablet_bootstrap.cc:654] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.607981 26927 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.604683 27127 raft_consensus.cc:493] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.609035 27127 raft_consensus.cc:515] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.609162 27042 leader_election.cc:304] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.610226 27160 raft_consensus.cc:2804] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.610764 27160 raft_consensus.cc:697] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:19.611953 27127 leader_election.cc:290] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.613044 27001 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.615139 27000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62378012bc404711865789d9bd2c95c6" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.618443 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62378012bc404711865789d9bd2c95c6" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.619136 26927 raft_consensus.cc:2468] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
W20260503 07:56:19.619366 26890 consensus_peers.cc:597] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc -> Peer 9282b76d980744839836fb69867fa36e (127.26.42.3:36553): Couldn't send request to peer 9282b76d980744839836fb69867fa36e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:56:19.616212 27160 consensus_queue.cc:237] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.620883 27042 leader_election.cc:304] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.622219 27163 raft_consensus.cc:2804] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:19.622570 27163 raft_consensus.cc:493] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.622860 27163 raft_consensus.cc:3060] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.628293 27119 raft_consensus.cc:359] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.628976 27119 raft_consensus.cc:385] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.629318 27119 raft_consensus.cc:740] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.629974 27119 consensus_queue.cc:260] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.631268 27000 raft_consensus.cc:2468] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.631816 27119 ts_tablet_manager.cc:1434] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52: Time spent starting tablet: real 0.036s user 0.008s sys 0.000s
I20260503 07:56:19.632495 27160 raft_consensus.cc:493] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.632864 27160 raft_consensus.cc:515] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.633229 27163 raft_consensus.cc:515] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.634557 27122 tablet_bootstrap.cc:492] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.634858 27163 leader_election.cc:290] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.635298 27122 ts_tablet_manager.cc:1403] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.010s
I20260503 07:56:19.636088 27000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.636638 27000 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.637683 27039 leader_election.cc:304] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.637877 27122 raft_consensus.cc:359] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:19.638639 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62378012bc404711865789d9bd2c95c6" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.639088 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.639194 27001 raft_consensus.cc:3060] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.639190 26926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62378012bc404711865789d9bd2c95c6" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:19.639671 26927 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 0.
I20260503 07:56:19.639858 26926 raft_consensus.cc:3060] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.641268 27137 raft_consensus.cc:493] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.641656 27137 raft_consensus.cc:515] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.643342 27163 raft_consensus.cc:2804] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:19.643678 27163 raft_consensus.cc:493] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.643981 27163 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.645498 26824 catalog_manager.cc:5671] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 1 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:19.646740 26926 raft_consensus.cc:2468] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.647543 27001 raft_consensus.cc:2468] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.647683 27042 leader_election.cc:304] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.648312 27127 raft_consensus.cc:2804] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.648743 27160 leader_election.cc:290] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.638640 27122 raft_consensus.cc:385] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.649554 27122 raft_consensus.cc:740] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.651944 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.652072 27137 leader_election.cc:290] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.652472 27001 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 0.
I20260503 07:56:19.653360 26890 leader_election.cc:304] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:19.653445 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e" is_pre_election: true
I20260503 07:56:19.654042 27137 raft_consensus.cc:2804] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:19.653934 27163 raft_consensus.cc:515] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.654479 27137 raft_consensus.cc:493] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:19.654029 27075 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 0.
I20260503 07:56:19.654790 27137 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.650161 27122 consensus_queue.cc:260] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:19.655541 27127 raft_consensus.cc:697] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:19.656801 26926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:19.657516 26926 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.658635 27122 ts_tablet_manager.cc:1434] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260503 07:56:19.659430 27122 tablet_bootstrap.cc:492] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e: Bootstrap starting.
I20260503 07:56:19.657519 27127 consensus_queue.cc:237] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.666059 27163 leader_election.cc:290] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.667133 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.667624 27001 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.667557 26926 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.668612 27042 leader_election.cc:304] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.669415 27163 raft_consensus.cc:2804] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.670100 27163 raft_consensus.cc:697] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:19.670846 27163 consensus_queue.cc:237] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.673523 27001 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 1.
I20260503 07:56:19.674580 27122 tablet_bootstrap.cc:654] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:19.668985 27137 raft_consensus.cc:515] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.682821 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:19.683312 27075 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.683210 26822 catalog_manager.cc:5671] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 1 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:19.681147 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:19.684489 27001 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.683924 27137 leader_election.cc:290] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:19.689699 27075 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 1.
I20260503 07:56:19.691455 27001 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 1.
I20260503 07:56:19.692116 26890 leader_election.cc:304] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:19.695072 27137 raft_consensus.cc:2804] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:19.695539 27137 raft_consensus.cc:697] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:19.696602 27137 consensus_queue.cc:237] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.698266 27122 tablet_bootstrap.cc:492] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e: No bootstrap required, opened a new log
I20260503 07:56:19.698655 27122 ts_tablet_manager.cc:1403] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.002s
I20260503 07:56:19.699683 26822 catalog_manager.cc:5671] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 1 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:19.701579 27122 raft_consensus.cc:359] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.702351 27122 raft_consensus.cc:385] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:19.702605 27122 raft_consensus.cc:740] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Initialized, Role: FOLLOWER
I20260503 07:56:19.703215 27122 consensus_queue.cc:260] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.706889 26824 catalog_manager.cc:5671] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 1 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:19.710183 27122 ts_tablet_manager.cc:1434] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260503 07:56:19.744114 27163 raft_consensus.cc:493] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.744539 27163 raft_consensus.cc:515] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:19.746757 27163 leader_election.cc:290] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:19.747105 26926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.747283 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.747915 27001 raft_consensus.cc:2393] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9282b76d980744839836fb69867fa36e in current term 1: Already voted for candidate 53f788d4fc9449789bcb3a04afde68fc in this term.
I20260503 07:56:19.748765 27039 leader_election.cc:304] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9282b76d980744839836fb69867fa36e; no voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc
I20260503 07:56:19.749416 27163 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.754153 27163 raft_consensus.cc:2749] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:56:19.856748 27163 consensus_queue.cc:1048] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.859095 27137 consensus_queue.cc:1048] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.873204 27173 consensus_queue.cc:1048] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:56:19.875340 27137 consensus_queue.cc:1048] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.911762 27123 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.922966 27075 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:19.929567 27173 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.931738 27183 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.951119 27127 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:19.970885 27127 raft_consensus.cc:493] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:19.971484 27127 raft_consensus.cc:515] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:19.973302 27127 leader_election.cc:290] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943)
I20260503 07:56:19.974045 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b67137972744d32ac88241d9e68fd52" is_pre_election: true
I20260503 07:56:19.975025 26926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53f788d4fc9449789bcb3a04afde68fc" is_pre_election: true
I20260503 07:56:19.976243 27042 leader_election.cc:304] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9282b76d980744839836fb69867fa36e; no voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc
I20260503 07:56:19.976986 27127 raft_consensus.cc:2749] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:56:19.980887 27076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63"
dest_uuid: "9282b76d980744839836fb69867fa36e"
mode: GRACEFUL
new_leader_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:35302
I20260503 07:56:19.981439 27076 raft_consensus.cc:606] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Received request to transfer leadership to TS 53f788d4fc9449789bcb3a04afde68fc
I20260503 07:56:19.986322 27076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd"
dest_uuid: "9282b76d980744839836fb69867fa36e"
mode: GRACEFUL
new_leader_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:35302
I20260503 07:56:19.986869 27076 raft_consensus.cc:606] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Received request to transfer leadership to TS 53f788d4fc9449789bcb3a04afde68fc
I20260503 07:56:20.004194 26926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35066
I20260503 07:56:20.004694 26926 raft_consensus.cc:606] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:20.010090 27076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de"
dest_uuid: "9282b76d980744839836fb69867fa36e"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35302
I20260503 07:56:20.010486 27076 raft_consensus.cc:606] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:20.014700 27076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b"
dest_uuid: "9282b76d980744839836fb69867fa36e"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35302
I20260503 07:56:20.015272 27076 raft_consensus.cc:606] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:20.019515 26926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35066
I20260503 07:56:20.020027 26926 raft_consensus.cc:606] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:20.100670 27076 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:20.106143 27163 consensus_queue.cc:1048] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.115566 27163 consensus_queue.cc:1048] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.137197 27160 consensus_queue.cc:1048] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.140141 27163 consensus_queue.cc:1048] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.146692 27160 raft_consensus.cc:993] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.147064 27160 raft_consensus.cc:1081] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.149361 27001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35986
I20260503 07:56:20.149899 27001 raft_consensus.cc:493] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:20.150209 27001 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.157492 27001 raft_consensus.cc:515] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.161370 27001 leader_election.cc:290] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:20.161576 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:20.162086 27076 raft_consensus.cc:3055] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:20.162371 27076 raft_consensus.cc:740] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:20.162504 26926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:20.163056 26926 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.163110 27076 consensus_queue.cc:260] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.164453 27076 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.168877 26926 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.171093 27076 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.171088 26968 leader_election.cc:304] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:20.171905 27138 raft_consensus.cc:2804] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:20.172910 27138 raft_consensus.cc:697] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:20.173810 27138 consensus_queue.cc:237] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.181138 26823 catalog_manager.cc:5671] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 1 to 2, leader changed from 9282b76d980744839836fb69867fa36e (127.26.42.3) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:20.191177 27163 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.192194 27137 consensus_queue.cc:1048] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.194445 27163 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.227324 27123 consensus_queue.cc:1048] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:20.228490 27127 raft_consensus.cc:993] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e: : Instructing follower 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:20.228891 27160 raft_consensus.cc:1081] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Signalling peer 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:20.230710 26927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:35056
I20260503 07:56:20.231204 26927 raft_consensus.cc:493] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:20.231555 26927 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.238518 26927 raft_consensus.cc:515] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.240980 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:20.241513 27002 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.249473 27002 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 2.
I20260503 07:56:20.250427 26890 leader_election.cc:304] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:20.251641 27137 raft_consensus.cc:2804] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:20.252202 27137 raft_consensus.cc:697] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:20.253641 27137 consensus_queue.cc:237] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.254492 26927 leader_election.cc:290] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 2 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:20.256706 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:20.257264 27076 raft_consensus.cc:3055] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:20.257611 27076 raft_consensus.cc:740] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:20.258342 27076 consensus_queue.cc:260] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.259383 27076 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.263026 27183 raft_consensus.cc:993] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.263447 27123 raft_consensus.cc:1081] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.267251 27076 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 2.
I20260503 07:56:20.268896 27002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35970
I20260503 07:56:20.269506 27002 raft_consensus.cc:493] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:20.269925 27002 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.270684 26824 catalog_manager.cc:5671] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 1 to 2, leader changed from 9282b76d980744839836fb69867fa36e (127.26.42.3) to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 2 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:20.275997 27002 raft_consensus.cc:515] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.277640 27002 leader_election.cc:290] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:20.279137 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:20.279476 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:20.281860 27076 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.281931 26927 raft_consensus.cc:3055] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:20.282338 26927 raft_consensus.cc:740] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:20.283036 26927 consensus_queue.cc:260] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.284129 26927 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.287664 27076 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.288707 26965 leader_election.cc:304] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:20.289481 27138 raft_consensus.cc:2804] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:20.289945 27138 raft_consensus.cc:697] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:20.290128 26927 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.290707 27138 consensus_queue.cc:237] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.296512 26824 catalog_manager.cc:5671] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 1 to 2, leader changed from 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:20.429772 27127 raft_consensus.cc:993] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e: : Instructing follower 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:20.430272 27160 raft_consensus.cc:1081] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Signalling peer 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:20.432026 26927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:35056
I20260503 07:56:20.432471 26927 raft_consensus.cc:493] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:20.432811 26927 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.437368 26927 raft_consensus.cc:515] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.439266 26927 leader_election.cc:290] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 2 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:20.440445 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:20.441044 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:20.441401 27002 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.441808 27076 raft_consensus.cc:3055] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:20.442276 27076 raft_consensus.cc:740] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:20.443143 27076 consensus_queue.cc:260] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.444043 27076 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.448046 27076 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 2.
I20260503 07:56:20.448657 27002 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 2.
I20260503 07:56:20.448930 26890 leader_election.cc:304] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:20.449770 27137 raft_consensus.cc:2804] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:20.450196 27137 raft_consensus.cc:697] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:20.450906 27137 consensus_queue.cc:237] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.458196 26824 catalog_manager.cc:5671] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 1 to 2, leader changed from 9282b76d980744839836fb69867fa36e (127.26.42.3) to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 2 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:20.498620 27173 raft_consensus.cc:993] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.499030 27173 raft_consensus.cc:1081] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.500762 27002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35986
I20260503 07:56:20.501267 27002 raft_consensus.cc:493] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:20.501579 27002 raft_consensus.cc:3060] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.506232 27002 raft_consensus.cc:515] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.508183 27002 leader_election.cc:290] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:20.510082 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:20.510625 27076 raft_consensus.cc:3055] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:20.510970 27076 raft_consensus.cc:740] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:20.511616 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479a0006f2524001b238124d35b7fb6b" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:20.512027 27183 raft_consensus.cc:993] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.511741 27076 consensus_queue.cc:260] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.512421 27123 raft_consensus.cc:1081] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:20.512957 27076 raft_consensus.cc:3060] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.512151 26927 raft_consensus.cc:3060] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.516124 27002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35970
I20260503 07:56:20.516613 27002 raft_consensus.cc:493] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:20.516932 27002 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.519366 27076 raft_consensus.cc:2468] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.519567 26927 raft_consensus.cc:2468] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.520537 26965 leader_election.cc:304] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:20.522797 27002 raft_consensus.cc:515] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.521415 27138 raft_consensus.cc:2804] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:20.525138 27002 leader_election.cc:290] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:20.525740 27138 raft_consensus.cc:697] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:20.526293 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:20.526777 26927 raft_consensus.cc:3055] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:20.526552 27138 consensus_queue.cc:237] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.526810 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:20.527186 26927 raft_consensus.cc:740] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:20.527643 27076 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.527925 26927 consensus_queue.cc:260] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.529134 26927 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:20.534134 27076 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.535156 26927 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:20.535269 26965 leader_election.cc:304] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:20.536317 27138 raft_consensus.cc:2804] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:20.536725 27138 raft_consensus.cc:697] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:20.536206 26824 catalog_manager.cc:5671] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 1 to 2, leader changed from 9282b76d980744839836fb69867fa36e (127.26.42.3) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:20.537978 27138 consensus_queue.cc:237] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:20.548141 26824 catalog_manager.cc:5671] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 1 to 2, leader changed from 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:20.593842 27076 raft_consensus.cc:1275] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.594883 27138 consensus_queue.cc:1048] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.603833 26927 raft_consensus.cc:1275] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.605185 27201 consensus_queue.cc:1048] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.729970 27076 raft_consensus.cc:1275] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.731284 27123 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.734282 27002 raft_consensus.cc:1275] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.735762 27137 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.777328 27076 raft_consensus.cc:1275] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.778275 27201 consensus_queue.cc:1048] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.784845 26927 raft_consensus.cc:1275] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.786521 27202 consensus_queue.cc:1048] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.882725 27076 raft_consensus.cc:1275] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.883796 27123 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.890904 27002 raft_consensus.cc:1275] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.892403 27137 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.956327 26927 raft_consensus.cc:1275] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.957425 27202 consensus_queue.cc:1048] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:20.966004 27076 raft_consensus.cc:1275] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:20.967195 27202 consensus_queue.cc:1048] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:21.102367 27076 raft_consensus.cc:1275] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:21.103399 27202 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:21.110419 26927 raft_consensus.cc:1275] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:21.112033 27202 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:23.047605 26792 auto_leader_rebalancer-test.cc:272] The leader distribution is
I20260503 07:56:23.048321 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:23.061735 27002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
mode: GRACEFUL
new_leader_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:49116
I20260503 07:56:23.062163 27002 raft_consensus.cc:606] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Received request to transfer leadership to TS 9282b76d980744839836fb69867fa36e
I20260503 07:56:23.070573 26927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
mode: GRACEFUL
new_leader_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:49144
I20260503 07:56:23.070928 26927 raft_consensus.cc:606] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Received request to transfer leadership to TS 9282b76d980744839836fb69867fa36e
I20260503 07:56:23.071730 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260503 07:56:23.072134 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:23.175364 27203 raft_consensus.cc:993] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc: : Instructing follower 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:23.175789 27211 raft_consensus.cc:1081] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Signalling peer 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:23.177034 27075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1"
dest_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:35292
I20260503 07:56:23.177459 27075 raft_consensus.cc:493] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:23.177771 27075 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:23.181908 27075 raft_consensus.cc:515] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:23.183235 27075 leader_election.cc:290] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 2 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:23.183899 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:23.184149 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:23.184484 26927 raft_consensus.cc:3055] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:23.184684 27002 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:23.184872 26927 raft_consensus.cc:740] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:23.185631 26927 consensus_queue.cc:260] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:23.186450 26927 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:23.188987 27002 raft_consensus.cc:2468] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 2.
I20260503 07:56:23.190081 27039 leader_election.cc:304] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:23.190750 26927 raft_consensus.cc:2468] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 2.
I20260503 07:56:23.190806 27160 raft_consensus.cc:2804] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:23.192083 27160 raft_consensus.cc:697] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:23.192763 27160 consensus_queue.cc:237] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:23.198252 26823 catalog_manager.cc:5671] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 1 to 2, leader changed from 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1) to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 2 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:23.475502 27218 raft_consensus.cc:993] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52: : Instructing follower 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:23.475925 27202 raft_consensus.cc:1081] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Signalling peer 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:23.477128 27075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb"
dest_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:35282
I20260503 07:56:23.477571 27075 raft_consensus.cc:493] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:23.477859 27075 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:23.483019 27075 raft_consensus.cc:515] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:23.484493 27075 leader_election.cc:290] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 3 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:23.485153 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:23.485466 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:23.485682 26927 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:23.486027 27002 raft_consensus.cc:3055] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:23.486297 27002 raft_consensus.cc:740] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:23.486908 27002 consensus_queue.cc:260] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:23.487720 27002 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:23.489996 26927 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 3.
I20260503 07:56:23.490849 27042 leader_election.cc:304] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:23.491544 27160 raft_consensus.cc:2804] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:23.491962 27160 raft_consensus.cc:697] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:23.492134 27002 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 3.
I20260503 07:56:23.492717 27160 consensus_queue.cc:237] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:23.500924 26823 catalog_manager.cc:5671] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 2 to 3, leader changed from 0b67137972744d32ac88241d9e68fd52 (127.26.42.2) to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 3 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:23.701423 26927 raft_consensus.cc:1275] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:23.702498 27160 consensus_queue.cc:1048] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:23.710443 27002 raft_consensus.cc:1275] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:23.711844 27160 consensus_queue.cc:1048] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:23.974659 27002 raft_consensus.cc:1275] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:23.975746 27160 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:23.983000 26927 raft_consensus.cc:1275] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:23.984102 27226 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:24.072892 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:24.077404 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:24.077739 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:25.078493 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:25.082881 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:25.083266 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:26.084013 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:26.089044 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:26.089435 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:27.090404 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:27.095217 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:27.095587 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:28.096432 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:28.101622 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:28.102005 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:29.102931 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:29.107347 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:29.107717 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:30.108469 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:30.113543 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:30.113968 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:31.114697 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:31.119521 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:31.119875 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:32.120610 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:32.124951 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:32.125361 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:33.147444 26792 auto_leader_rebalancer-test.cc:291] The leader distribution is
I20260503 07:56:33.151428 26927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facee198c7534df99001437eeef1aba7"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35066
I20260503 07:56:33.151991 26927 raft_consensus.cc:606] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:33.155982 26927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35066
I20260503 07:56:33.156334 26927 raft_consensus.cc:606] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:33.159795 26927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35066
I20260503 07:56:33.160176 26927 raft_consensus.cc:606] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:33.164006 27075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1"
dest_uuid: "9282b76d980744839836fb69867fa36e"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35302
I20260503 07:56:33.164361 27075 raft_consensus.cc:606] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:33.173552 27075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb"
dest_uuid: "9282b76d980744839836fb69867fa36e"
mode: GRACEFUL
new_leader_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35302
I20260503 07:56:33.173920 27075 raft_consensus.cc:606] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Received request to transfer leadership to TS 0b67137972744d32ac88241d9e68fd52
I20260503 07:56:33.208041 27232 raft_consensus.cc:993] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.208490 27235 raft_consensus.cc:1081] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.209720 27001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35970
I20260503 07:56:33.210116 27001 raft_consensus.cc:493] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:33.210412 27001 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.214534 27001 raft_consensus.cc:515] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.215886 27001 leader_election.cc:290] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 3 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:33.216414 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:33.216742 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:33.217135 26927 raft_consensus.cc:3055] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:33.217213 27075 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.217382 26927 raft_consensus.cc:740] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:33.218135 26927 consensus_queue.cc:260] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.218978 26927 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.221279 27075 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 3.
I20260503 07:56:33.222206 26965 leader_election.cc:304] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:33.222910 27202 raft_consensus.cc:2804] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:33.223146 26927 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 3.
I20260503 07:56:33.223837 27202 raft_consensus.cc:697] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:33.224956 27202 consensus_queue.cc:237] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.230660 26823 catalog_manager.cc:5671] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 2 to 3, leader changed from 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:33.261509 27229 raft_consensus.cc:993] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.261946 27242 raft_consensus.cc:1081] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.263024 27001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35986
I20260503 07:56:33.263396 27001 raft_consensus.cc:493] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:33.263652 27001 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:33.267112 27001 raft_consensus.cc:515] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.268220 27001 leader_election.cc:290] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 4 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:33.268957 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:33.269158 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3109ae7ea47448088ea4269d5c9f0acb" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:33.269423 26927 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:33.269644 27075 raft_consensus.cc:3055] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:56:33.269932 27075 raft_consensus.cc:740] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:33.270426 27075 consensus_queue.cc:260] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.271206 27075 raft_consensus.cc:3060] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:33.273454 26927 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 4.
I20260503 07:56:33.274312 26968 leader_election.cc:304] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:33.275020 27202 raft_consensus.cc:2804] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:56:33.275605 27075 raft_consensus.cc:2468] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 4.
I20260503 07:56:33.276124 27202 raft_consensus.cc:697] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 4 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:33.276782 27202 consensus_queue.cc:237] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.281965 26823 catalog_manager.cc:5671] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 3 to 4, leader changed from 9282b76d980744839836fb69867fa36e (127.26.42.3) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:33.553870 27229 raft_consensus.cc:993] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.554315 27242 raft_consensus.cc:1081] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.554939 27232 raft_consensus.cc:993] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.555380 27235 raft_consensus.cc:1081] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.555663 27001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35986
I20260503 07:56:33.556046 27001 raft_consensus.cc:493] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:33.556337 27001 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.556669 27002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "facee198c7534df99001437eeef1aba7"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35970
I20260503 07:56:33.557101 27002 raft_consensus.cc:493] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:33.557330 27002 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:33.560101 27001 raft_consensus.cc:515] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.561066 27002 raft_consensus.cc:515] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:33.561434 27001 leader_election.cc:290] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 3 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:33.562090 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:33.562314 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1cafd79812940b19b75935e08f91db1" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:33.562556 26927 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.562638 27002 leader_election.cc:290] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Requested vote from peers 9282b76d980744839836fb69867fa36e (127.26.42.3:36553), 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943)
I20260503 07:56:33.562772 27075 raft_consensus.cc:3055] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:33.563082 27075 raft_consensus.cc:740] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:33.563648 27076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:33.563714 27075 consensus_queue.cc:260] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.564169 27076 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:33.564738 27075 raft_consensus.cc:3060] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.564635 26926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:33.565212 26926 raft_consensus.cc:3055] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:33.565505 26926 raft_consensus.cc:740] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:33.566226 26926 consensus_queue.cc:260] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:33.568888 26927 raft_consensus.cc:2468] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 3.
I20260503 07:56:33.569737 26968 leader_election.cc:304] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:33.570231 27076 raft_consensus.cc:2468] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:33.570627 26926 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:33.570566 27202 raft_consensus.cc:2804] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:33.571190 26965 leader_election.cc:304] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:33.571398 27202 raft_consensus.cc:697] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:33.571061 27075 raft_consensus.cc:2468] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 3.
I20260503 07:56:33.572139 27243 raft_consensus.cc:2804] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:33.572590 27243 raft_consensus.cc:697] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:33.572286 27202 consensus_queue.cc:237] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.573450 27243 consensus_queue.cc:237] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:33.576880 26926 raft_consensus.cc:2468] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 2.
I20260503 07:56:33.579334 26823 catalog_manager.cc:5671] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 2 to 3, leader changed from 9282b76d980744839836fb69867fa36e (127.26.42.3) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:33.588491 26823 catalog_manager.cc:5671] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 1 to 2, leader changed from 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:33.727890 26926 raft_consensus.cc:1275] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:56:33.728857 27243 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:56:33.739158 27075 raft_consensus.cc:1275] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:56:33.740280 27243 consensus_queue.cc:1048] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:56:33.756570 27232 raft_consensus.cc:993] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc: : Instructing follower 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.756973 27235 raft_consensus.cc:1081] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Signalling peer 0b67137972744d32ac88241d9e68fd52 to start an election
I20260503 07:56:33.758112 27002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
from {username='slave'} at 127.0.0.1:35970
I20260503 07:56:33.758437 27002 raft_consensus.cc:493] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:33.758647 27002 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.761437 26926 raft_consensus.cc:1275] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:33.762398 27243 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:33.762470 27002 raft_consensus.cc:515] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.763742 27002 leader_election.cc:290] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 3 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:33.764303 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:33.764621 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "0b67137972744d32ac88241d9e68fd52" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:33.764786 26927 raft_consensus.cc:3055] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:33.765128 26927 raft_consensus.cc:740] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:33.765116 27075 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.765836 26927 consensus_queue.cc:260] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.766986 26927 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:33.771369 27076 raft_consensus.cc:1275] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:33.771423 27075 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 3.
I20260503 07:56:33.772320 26965 leader_election.cc:304] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:33.773015 27202 raft_consensus.cc:2804] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:33.773566 27236 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:33.774466 27202 raft_consensus.cc:697] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Becoming Leader. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:33.774892 26927 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b67137972744d32ac88241d9e68fd52 in term 3.
I20260503 07:56:33.775185 27202 consensus_queue.cc:237] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:33.788208 26823 catalog_manager.cc:5671] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 reported cstate change: term changed from 2 to 3, leader changed from 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1) to 0b67137972744d32ac88241d9e68fd52 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "0b67137972744d32ac88241d9e68fd52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:34.036571 27075 raft_consensus.cc:1275] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:34.037565 27202 consensus_queue.cc:1048] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:34.044626 26926 raft_consensus.cc:1275] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:34.045935 27236 consensus_queue.cc:1048] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:34.140970 26926 raft_consensus.cc:1275] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:34.141952 27236 consensus_queue.cc:1048] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:34.148808 27075 raft_consensus.cc:1275] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:34.150126 27202 consensus_queue.cc:1048] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:34.368906 26926 raft_consensus.cc:1275] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:34.370122 27236 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:34.378496 27075 raft_consensus.cc:1275] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Refusing update from remote peer 0b67137972744d32ac88241d9e68fd52: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:34.379745 27202 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:36.200582 26792 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20260503 07:56:36.201212 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:36.207199 27002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
mode: GRACEFUL
new_leader_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:49116
I20260503 07:56:36.207554 27002 raft_consensus.cc:606] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Received request to transfer leadership to TS 53f788d4fc9449789bcb3a04afde68fc
I20260503 07:56:36.209538 27002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
mode: GRACEFUL
new_leader_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:49116
I20260503 07:56:36.209983 27002 raft_consensus.cc:606] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Received request to transfer leadership to TS 53f788d4fc9449789bcb3a04afde68fc
I20260503 07:56:36.211901 27002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
mode: GRACEFUL
new_leader_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:49116
I20260503 07:56:36.212208 27002 raft_consensus.cc:606] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Received request to transfer leadership to TS 9282b76d980744839836fb69867fa36e
I20260503 07:56:36.213896 27002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
mode: GRACEFUL
new_leader_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:49116
I20260503 07:56:36.214200 27002 raft_consensus.cc:606] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Received request to transfer leadership to TS 53f788d4fc9449789bcb3a04afde68fc
I20260503 07:56:36.215962 27002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facee198c7534df99001437eeef1aba7"
dest_uuid: "0b67137972744d32ac88241d9e68fd52"
mode: GRACEFUL
new_leader_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:49116
I20260503 07:56:36.216310 27002 raft_consensus.cc:606] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Received request to transfer leadership to TS 9282b76d980744839836fb69867fa36e
I20260503 07:56:36.216995 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:56:36.217319 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:36.301671 27261 raft_consensus.cc:993] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52: : Instructing follower 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:36.302094 27236 raft_consensus.cc:1081] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Signalling peer 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:36.303179 26927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:35040
I20260503 07:56:36.303536 26927 raft_consensus.cc:493] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:36.303752 26927 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:36.317524 26927 raft_consensus.cc:515] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.319125 26927 leader_election.cc:290] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 4 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:36.319909 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:36.320031 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f127b74b0daf4769b1038bb0ca8a44cd" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:36.320478 27002 raft_consensus.cc:3055] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:56:36.320555 27075 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:36.320883 27002 raft_consensus.cc:740] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:36.321648 27002 consensus_queue.cc:260] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.322384 27002 raft_consensus.cc:3060] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:36.417335 27075 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 4.
I20260503 07:56:36.417330 27002 raft_consensus.cc:2468] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 4.
I20260503 07:56:36.418529 26890 leader_election.cc:304] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:36.419759 27262 raft_consensus.cc:2804] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:56:36.420748 27262 raft_consensus.cc:697] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 4 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:36.421518 27262 consensus_queue.cc:237] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.426834 26823 catalog_manager.cc:5671] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 3 to 4, leader changed from 0b67137972744d32ac88241d9e68fd52 (127.26.42.2) to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 4 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:36.560528 27261 raft_consensus.cc:993] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52: : Instructing follower 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:36.561275 27236 raft_consensus.cc:1081] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Signalling peer 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:36.562757 26927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:35040
I20260503 07:56:36.563272 26927 raft_consensus.cc:493] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:36.563562 26927 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.617511 27261 raft_consensus.cc:993] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52: : Instructing follower 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:36.617858 27270 raft_consensus.cc:993] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52: : Instructing follower 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:36.618122 27236 raft_consensus.cc:1081] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Signalling peer 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:36.618422 27261 raft_consensus.cc:1081] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Signalling peer 9282b76d980744839836fb69867fa36e to start an election
I20260503 07:56:36.619633 27076 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de"
dest_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:35282
I20260503 07:56:36.619838 27074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "facee198c7534df99001437eeef1aba7"
dest_uuid: "9282b76d980744839836fb69867fa36e"
from {username='slave'} at 127.0.0.1:35282
I20260503 07:56:36.620077 27076 raft_consensus.cc:493] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:36.620337 27074 raft_consensus.cc:493] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:36.620512 27076 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.620728 27074 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.628899 26927 raft_consensus.cc:515] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.630432 26927 leader_election.cc:290] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 3 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:36.631196 27002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:36.631379 27075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a1ffbac5ab40c8a713020dc7e06abb" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:36.631829 27002 raft_consensus.cc:3055] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:36.631984 27075 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.632086 27002 raft_consensus.cc:740] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:36.632700 27002 consensus_queue.cc:260] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.633628 27002 raft_consensus.cc:3060] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.681978 27236 raft_consensus.cc:993] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52: : Instructing follower 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:36.682360 27261 raft_consensus.cc:1081] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Signalling peer 53f788d4fc9449789bcb3a04afde68fc to start an election
I20260503 07:56:36.683501 26927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63"
dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
from {username='slave'} at 127.0.0.1:35040
I20260503 07:56:36.683890 26927 raft_consensus.cc:493] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:36.684134 26927 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:36.726212 27002 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 3.
I20260503 07:56:36.726361 27076 raft_consensus.cc:515] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.726296 27074 raft_consensus.cc:515] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:36.726241 26927 raft_consensus.cc:515] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.727874 26890 leader_election.cc:304] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:36.728974 27262 raft_consensus.cc:2804] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:36.729485 27076 leader_election.cc:290] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 3 election: Requested vote from peers 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943), 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111)
I20260503 07:56:36.729501 27262 raft_consensus.cc:697] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 3 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:36.730931 26926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:36.731210 27001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca07b0ba1a944c15bf1efed6e91347de" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:36.731599 26926 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.731725 27074 leader_election.cc:290] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 3 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943)
I20260503 07:56:36.731779 27001 raft_consensus.cc:3055] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:36.732223 27001 raft_consensus.cc:740] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:36.731725 27262 consensus_queue.cc:237] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.732834 27001 consensus_queue.cc:260] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.734073 27001 raft_consensus.cc:3060] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.734252 26927 leader_election.cc:290] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 4 election: Requested vote from peers 0b67137972744d32ac88241d9e68fd52 (127.26.42.2:44111), 9282b76d980744839836fb69867fa36e (127.26.42.3:36553)
I20260503 07:56:36.735545 26927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53f788d4fc9449789bcb3a04afde68fc"
I20260503 07:56:36.736049 27000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:36.736589 27000 raft_consensus.cc:3055] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:56:36.736841 27000 raft_consensus.cc:740] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:36.737653 27000 consensus_queue.cc:260] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.738065 26999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facee198c7534df99001437eeef1aba7" candidate_uuid: "9282b76d980744839836fb69867fa36e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0b67137972744d32ac88241d9e68fd52"
I20260503 07:56:36.738646 26999 raft_consensus.cc:3055] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:36.738938 27000 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:36.738989 26999 raft_consensus.cc:740] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0b67137972744d32ac88241d9e68fd52, State: Running, Role: LEADER
I20260503 07:56:36.739498 26926 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 3.
I20260503 07:56:36.739846 26999 consensus_queue.cc:260] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:36.740702 27001 raft_consensus.cc:2468] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 3.
I20260503 07:56:36.741804 27042 leader_election.cc:304] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:36.742697 27242 raft_consensus.cc:2804] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:36.743323 27075 raft_consensus.cc:2468] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 3.
I20260503 07:56:36.744462 27242 raft_consensus.cc:697] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:36.736049 26927 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.745556 26999 raft_consensus.cc:3060] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:36.745489 27242 consensus_queue.cc:237] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.750687 26927 raft_consensus.cc:2468] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 3.
I20260503 07:56:36.748615 27000 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 4.
I20260503 07:56:36.751977 27042 leader_election.cc:304] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f788d4fc9449789bcb3a04afde68fc, 9282b76d980744839836fb69867fa36e; no voters:
I20260503 07:56:36.752295 26890 leader_election.cc:304] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b67137972744d32ac88241d9e68fd52, 53f788d4fc9449789bcb3a04afde68fc; no voters:
I20260503 07:56:36.753106 27262 raft_consensus.cc:2804] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:56:36.753857 27262 raft_consensus.cc:697] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 4 LEADER]: Becoming Leader. State: Replica: 53f788d4fc9449789bcb3a04afde68fc, State: Running, Role: LEADER
I20260503 07:56:36.738638 27074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9daa0a2d774f4cfc92815a8680401e63" candidate_uuid: "53f788d4fc9449789bcb3a04afde68fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9282b76d980744839836fb69867fa36e"
I20260503 07:56:36.754803 27074 raft_consensus.cc:3060] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:56:36.754747 27262 consensus_queue.cc:237] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } }
I20260503 07:56:36.754977 26823 catalog_manager.cc:5671] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 2 to 3, leader changed from 0b67137972744d32ac88241d9e68fd52 (127.26.42.2) to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 3 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:36.755704 27273 raft_consensus.cc:2804] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:36.758924 26999 raft_consensus.cc:2468] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9282b76d980744839836fb69867fa36e in term 3.
I20260503 07:56:36.762451 27273 raft_consensus.cc:697] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Becoming Leader. State: Replica: 9282b76d980744839836fb69867fa36e, State: Running, Role: LEADER
I20260503 07:56:36.762952 27074 raft_consensus.cc:2468] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f788d4fc9449789bcb3a04afde68fc in term 4.
I20260503 07:56:36.763482 27273 consensus_queue.cc:237] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } }
I20260503 07:56:36.769248 26822 catalog_manager.cc:5671] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 2 to 3, leader changed from 0b67137972744d32ac88241d9e68fd52 (127.26.42.2) to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 3 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:36.774293 26823 catalog_manager.cc:5671] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc reported cstate change: term changed from 3 to 4, leader changed from 0b67137972744d32ac88241d9e68fd52 (127.26.42.2) to 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1). New cstate: current_term: 4 leader_uuid: "53f788d4fc9449789bcb3a04afde68fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:36.780628 26822 catalog_manager.cc:5671] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e reported cstate change: term changed from 2 to 3, leader changed from 0b67137972744d32ac88241d9e68fd52 (127.26.42.2) to 9282b76d980744839836fb69867fa36e (127.26.42.3). New cstate: current_term: 3 leader_uuid: "9282b76d980744839836fb69867fa36e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:36.874361 27074 raft_consensus.cc:1275] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:56:36.875260 27262 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:56:36.885269 26999 raft_consensus.cc:1275] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:56:36.887063 27262 consensus_queue.cc:1048] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:56:37.163800 27074 raft_consensus.cc:1275] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:37.164894 27263 consensus_queue.cc:1048] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:37.166142 26999 raft_consensus.cc:1275] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:37.167369 27263 consensus_queue.cc:1048] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:37.248737 26926 raft_consensus.cc:1275] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:37.250177 27273 consensus_queue.cc:1048] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:37.261873 26999 raft_consensus.cc:1275] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:37.263065 27275 consensus_queue.cc:1048] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:37.266161 27074 raft_consensus.cc:1275] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:56:37.267556 27262 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9282b76d980744839836fb69867fa36e" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 36553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:56:37.276666 26999 raft_consensus.cc:1275] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Refusing update from remote peer 53f788d4fc9449789bcb3a04afde68fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:56:37.275449 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:37.278590 27289 consensus_queue.cc:1048] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260503 07:56:37.337334 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:37.365952 26999 raft_consensus.cc:1275] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:37.366389 26926 raft_consensus.cc:1275] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Refusing update from remote peer 9282b76d980744839836fb69867fa36e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:37.367405 27273 consensus_queue.cc:1048] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b67137972744d32ac88241d9e68fd52" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 44111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:37.368170 27275 consensus_queue.cc:1048] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f788d4fc9449789bcb3a04afde68fc" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:37.372620 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260503 07:56:38.302649 26948 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 26795
W20260503 07:56:38.303329 26948 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7740 after lost signal to thread 26858
W20260503 07:56:38.304024 26948 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6040 after lost signal to thread 26951
W20260503 07:56:38.304664 26948 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5040 after lost signal to thread 27026
W20260503 07:56:38.305513 26948 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9ec0 after lost signal to thread 27100
I20260503 07:56:38.374109 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:38.380559 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:38.380981 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:39.381980 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:39.386561 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:39.386920 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:40.387705 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:40.392258 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:40.392614 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:41.393548 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:41.398061 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:41.398402 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:42.399204 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:42.404353 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:42.404825 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:43.405682 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:43.409942 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:43.410269 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:44.411212 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:44.416663 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:44.417095 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:45.417979 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:45.422640 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:45.423004 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:46.447352 26792 auto_leader_rebalancer-test.cc:318] The leader distribution is
I20260503 07:56:46.447835 26792 tablet_server.cc:179] TabletServer@127.26.42.1:0 shutting down...
W20260503 07:56:46.468694 26968 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260503 07:56:46.471364 26792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260503 07:56:46.471683 26968 consensus_peers.cc:597] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 -> Peer 53f788d4fc9449789bcb3a04afde68fc (127.26.42.1:41943): Couldn't send request to peer 53f788d4fc9449789bcb3a04afde68fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:56:46.472193 26792 tablet_replica.cc:333] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.472849 26792 raft_consensus.cc:2243] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.473341 26792 raft_consensus.cc:2272] T ca07b0ba1a944c15bf1efed6e91347de P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.475252 26792 tablet_replica.cc:333] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.475703 26792 raft_consensus.cc:2243] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.476047 26792 raft_consensus.cc:2272] T 479a0006f2524001b238124d35b7fb6b P 53f788d4fc9449789bcb3a04afde68fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.477514 26792 tablet_replica.cc:333] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.477957 26792 raft_consensus.cc:2243] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.478296 26792 raft_consensus.cc:2272] T 62378012bc404711865789d9bd2c95c6 P 53f788d4fc9449789bcb3a04afde68fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.479676 26792 tablet_replica.cc:333] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.480155 26792 raft_consensus.cc:2243] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 4 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.480774 26792 raft_consensus.cc:2272] T f127b74b0daf4769b1038bb0ca8a44cd P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.482146 26792 tablet_replica.cc:333] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.482579 26792 raft_consensus.cc:2243] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.482935 26792 raft_consensus.cc:2272] T 3109ae7ea47448088ea4269d5c9f0acb P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.484222 26792 tablet_replica.cc:333] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.484622 26792 raft_consensus.cc:2243] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.484975 26792 raft_consensus.cc:2272] T e1cafd79812940b19b75935e08f91db1 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.486548 26792 tablet_replica.cc:333] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.486929 26792 raft_consensus.cc:2243] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 3 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.487449 26792 raft_consensus.cc:2272] T 47a1ffbac5ab40c8a713020dc7e06abb P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.488772 26792 tablet_replica.cc:333] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.489383 26792 raft_consensus.cc:2243] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 4 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.489966 26792 raft_consensus.cc:2272] T 9daa0a2d774f4cfc92815a8680401e63 P 53f788d4fc9449789bcb3a04afde68fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.491304 26792 tablet_replica.cc:333] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc: stopping tablet replica
I20260503 07:56:46.491701 26792 raft_consensus.cc:2243] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.492115 26792 raft_consensus.cc:2272] T facee198c7534df99001437eeef1aba7 P 53f788d4fc9449789bcb3a04afde68fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.609407 26792 tablet_server.cc:196] TabletServer@127.26.42.1:0 shutdown complete.
I20260503 07:56:46.631096 26792 tablet_server.cc:179] TabletServer@127.26.42.2:0 shutting down...
I20260503 07:56:46.656075 26792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260503 07:56:46.657116 26792 tablet_replica.cc:333] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.657860 26792 raft_consensus.cc:2243] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.658489 26792 raft_consensus.cc:2272] T f127b74b0daf4769b1038bb0ca8a44cd P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.660212 26792 tablet_replica.cc:333] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.660740 26792 raft_consensus.cc:2243] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.661290 26792 raft_consensus.cc:2272] T ca07b0ba1a944c15bf1efed6e91347de P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.662798 26792 tablet_replica.cc:333] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.663357 26792 raft_consensus.cc:2243] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.663749 26792 raft_consensus.cc:2272] T 62378012bc404711865789d9bd2c95c6 P 0b67137972744d32ac88241d9e68fd52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.665217 26792 tablet_replica.cc:333] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.665679 26792 raft_consensus.cc:2243] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 2 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.666539 26792 raft_consensus.cc:2272] T 479a0006f2524001b238124d35b7fb6b P 0b67137972744d32ac88241d9e68fd52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.668044 26792 tablet_replica.cc:333] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.668473 26792 raft_consensus.cc:2243] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.668853 26792 raft_consensus.cc:2272] T 47a1ffbac5ab40c8a713020dc7e06abb P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.670324 26792 tablet_replica.cc:333] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.670749 26792 raft_consensus.cc:2243] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.671186 26792 raft_consensus.cc:2272] T 9daa0a2d774f4cfc92815a8680401e63 P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.672618 26792 tablet_replica.cc:333] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.673153 26792 raft_consensus.cc:2243] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 3 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.674063 26792 raft_consensus.cc:2272] T e1cafd79812940b19b75935e08f91db1 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.675575 26792 tablet_replica.cc:333] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.676013 26792 raft_consensus.cc:2243] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 4 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.676954 26792 raft_consensus.cc:2272] T 3109ae7ea47448088ea4269d5c9f0acb P 0b67137972744d32ac88241d9e68fd52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.678509 26792 tablet_replica.cc:333] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52: stopping tablet replica
I20260503 07:56:46.678937 26792 raft_consensus.cc:2243] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.679307 26792 raft_consensus.cc:2272] T facee198c7534df99001437eeef1aba7 P 0b67137972744d32ac88241d9e68fd52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.706473 26792 tablet_server.cc:196] TabletServer@127.26.42.2:0 shutdown complete.
I20260503 07:56:46.723805 26792 tablet_server.cc:179] TabletServer@127.26.42.3:0 shutting down...
I20260503 07:56:46.748955 26792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260503 07:56:46.749706 26792 tablet_replica.cc:333] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.750581 26792 raft_consensus.cc:2243] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.751050 26792 raft_consensus.cc:2272] T 3109ae7ea47448088ea4269d5c9f0acb P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.752635 26792 tablet_replica.cc:333] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.753137 26792 raft_consensus.cc:2243] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.753902 26792 raft_consensus.cc:2272] T facee198c7534df99001437eeef1aba7 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.755366 26792 tablet_replica.cc:333] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.755752 26792 raft_consensus.cc:2243] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.756135 26792 raft_consensus.cc:2272] T e1cafd79812940b19b75935e08f91db1 P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.757675 26792 tablet_replica.cc:333] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.758075 26792 raft_consensus.cc:2243] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.758405 26792 raft_consensus.cc:2272] T 479a0006f2524001b238124d35b7fb6b P 9282b76d980744839836fb69867fa36e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.759791 26792 tablet_replica.cc:333] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.760258 26792 raft_consensus.cc:2243] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.760993 26792 raft_consensus.cc:2272] T 62378012bc404711865789d9bd2c95c6 P 9282b76d980744839836fb69867fa36e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.762593 26792 tablet_replica.cc:333] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.762995 26792 raft_consensus.cc:2243] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.763450 26792 raft_consensus.cc:2272] T f127b74b0daf4769b1038bb0ca8a44cd P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.764833 26792 tablet_replica.cc:333] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.765316 26792 raft_consensus.cc:2243] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 3 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.766129 26792 raft_consensus.cc:2272] T ca07b0ba1a944c15bf1efed6e91347de P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.767436 26792 tablet_replica.cc:333] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.767800 26792 raft_consensus.cc:2243] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.768157 26792 raft_consensus.cc:2272] T 47a1ffbac5ab40c8a713020dc7e06abb P 9282b76d980744839836fb69867fa36e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.769594 26792 tablet_replica.cc:333] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e: stopping tablet replica
I20260503 07:56:46.769959 26792 raft_consensus.cc:2243] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:56:46.770385 26792 raft_consensus.cc:2272] T 9daa0a2d774f4cfc92815a8680401e63 P 9282b76d980744839836fb69867fa36e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.796085 26792 tablet_server.cc:196] TabletServer@127.26.42.3:0 shutdown complete.
I20260503 07:56:46.811364 26792 master.cc:562] Master@127.26.42.62:45539 shutting down...
I20260503 07:56:46.971658 26792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:56:46.972267 26792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:56:46.972541 26792 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0bca1d6f2f514c01af9a4aa1844369c7: stopping tablet replica
I20260503 07:56:46.990468 26792 master.cc:584] Master@127.26.42.62:45539 shutdown complete.
0b67137972744d32ac88241d9e68fd52 4
53f788d4fc9449789bcb3a04afde68fc 4
9282b76d980744839836fb69867fa36e 1
0b67137972744d32ac88241d9e68fd52 3
53f788d4fc9449789bcb3a04afde68fc 3
9282b76d980744839836fb69867fa36e 3
0b67137972744d32ac88241d9e68fd52 8
53f788d4fc9449789bcb3a04afde68fc 0
9282b76d980744839836fb69867fa36e 1
0b67137972744d32ac88241d9e68fd52 3
53f788d4fc9449789bcb3a04afde68fc 3
9282b76d980744839836fb69867fa36e 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (30597 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260503 07:56:47.027467 26792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.42.62:38993
I20260503 07:56:47.028479 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:47.033341 27306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:47.033474 27305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:47.034608 27308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:47.035598 26792 server_base.cc:1061] running on GCE node
I20260503 07:56:47.036365 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:47.036566 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:47.036715 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795007036699 us; error 0 us; skew 500 ppm
I20260503 07:56:47.037238 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:47.039383 26792 webserver.cc:492] Webserver started at http://127.26.42.62:34525/ using document root <none> and password file <none>
I20260503 07:56:47.039811 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:47.039986 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:47.040220 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:47.041276 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/master-0-root/instance:
uuid: "953fa9db3d39427d8b1713e12f48a7b4"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.045578 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260503 07:56:47.048552 27313 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.049355 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260503 07:56:47.049563 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/master-0-root
uuid: "953fa9db3d39427d8b1713e12f48a7b4"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.049777 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:47.067852 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:47.068818 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:47.104305 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.62:38993
I20260503 07:56:47.104394 27364 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.62:38993 every 8 connection(s)
I20260503 07:56:47.108165 27365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.116856 27365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4: Bootstrap starting.
I20260503 07:56:47.121086 27365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.124794 27365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4: No bootstrap required, opened a new log
I20260503 07:56:47.126773 27365 raft_consensus.cc:359] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953fa9db3d39427d8b1713e12f48a7b4" member_type: VOTER }
I20260503 07:56:47.127202 27365 raft_consensus.cc:385] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.127431 27365 raft_consensus.cc:740] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 953fa9db3d39427d8b1713e12f48a7b4, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.128005 27365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953fa9db3d39427d8b1713e12f48a7b4" member_type: VOTER }
I20260503 07:56:47.128469 27365 raft_consensus.cc:399] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260503 07:56:47.128705 27365 raft_consensus.cc:493] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260503 07:56:47.128973 27365 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:47.132452 27365 raft_consensus.cc:515] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953fa9db3d39427d8b1713e12f48a7b4" member_type: VOTER }
I20260503 07:56:47.132957 27365 leader_election.cc:304] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 953fa9db3d39427d8b1713e12f48a7b4; no voters:
I20260503 07:56:47.133981 27365 leader_election.cc:290] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260503 07:56:47.134369 27368 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:47.135571 27368 raft_consensus.cc:697] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 1 LEADER]: Becoming Leader. State: Replica: 953fa9db3d39427d8b1713e12f48a7b4, State: Running, Role: LEADER
I20260503 07:56:47.136267 27368 consensus_queue.cc:237] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953fa9db3d39427d8b1713e12f48a7b4" member_type: VOTER }
I20260503 07:56:47.136716 27365 sys_catalog.cc:565] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260503 07:56:47.142897 27369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "953fa9db3d39427d8b1713e12f48a7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953fa9db3d39427d8b1713e12f48a7b4" member_type: VOTER } }
I20260503 07:56:47.142930 27370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 953fa9db3d39427d8b1713e12f48a7b4. Latest consensus state: current_term: 1 leader_uuid: "953fa9db3d39427d8b1713e12f48a7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953fa9db3d39427d8b1713e12f48a7b4" member_type: VOTER } }
I20260503 07:56:47.143652 27369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [sys.catalog]: This master's current role is: LEADER
I20260503 07:56:47.143731 27370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [sys.catalog]: This master's current role is: LEADER
I20260503 07:56:47.145591 27378 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260503 07:56:47.150432 27378 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260503 07:56:47.151563 26792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260503 07:56:47.158156 27378 catalog_manager.cc:1357] Generated new cluster ID: 1c7ceef86d0648bfb2e592efe5631e72
I20260503 07:56:47.158411 27378 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260503 07:56:47.182024 27378 catalog_manager.cc:1380] Generated new certificate authority record
I20260503 07:56:47.183133 27378 catalog_manager.cc:1514] Loading token signing keys...
I20260503 07:56:47.196066 27378 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4: Generated new TSK 0
I20260503 07:56:47.196585 27378 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260503 07:56:47.217408 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:47.222890 27386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:47.224409 27387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:47.225785 26792 server_base.cc:1061] running on GCE node
W20260503 07:56:47.226469 27389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:47.227236 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:47.227440 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:47.227734 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795007227700 us; error 0 us; skew 500 ppm
I20260503 07:56:47.228322 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:47.230423 26792 webserver.cc:492] Webserver started at http://127.26.42.1:40533/ using document root <none> and password file <none>
I20260503 07:56:47.230880 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:47.231076 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:47.231325 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:47.232340 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-0-root/instance:
uuid: "05a09fd797ae4b3fa5d100de0b16d623"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.236433 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260503 07:56:47.239542 27394 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.240268 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260503 07:56:47.240540 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-0-root
uuid: "05a09fd797ae4b3fa5d100de0b16d623"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.240783 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:47.259580 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:47.260828 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:47.262230 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:56:47.264274 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:56:47.264460 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.264709 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:56:47.264871 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.300899 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.1:35101
I20260503 07:56:47.300981 27456 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.1:35101 every 8 connection(s)
I20260503 07:56:47.305215 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:47.312451 27461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:47.313066 27462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:47.316613 27464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:47.322227 27457 heartbeater.cc:344] Connected to a master server at 127.26.42.62:38993
I20260503 07:56:47.322566 27457 heartbeater.cc:461] Registering TS with master...
I20260503 07:56:47.323194 27457 heartbeater.cc:507] Master 127.26.42.62:38993 requested a full tablet report, sending...
I20260503 07:56:47.323256 26792 server_base.cc:1061] running on GCE node
I20260503 07:56:47.324514 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:47.324685 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:47.324862 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795007324846 us; error 0 us; skew 500 ppm
I20260503 07:56:47.325134 27330 ts_manager.cc:194] Registered new tserver with Master: 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101)
I20260503 07:56:47.325474 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:47.326825 27330 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39086
I20260503 07:56:47.328060 26792 webserver.cc:492] Webserver started at http://127.26.42.2:34223/ using document root <none> and password file <none>
I20260503 07:56:47.328521 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:47.328693 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:47.328962 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:47.330022 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-1-root/instance:
uuid: "edc591aa9b374b5985e7624f26a6a854"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.333972 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260503 07:56:47.336973 27469 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.337720 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260503 07:56:47.338034 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-1-root
uuid: "edc591aa9b374b5985e7624f26a6a854"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.338310 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:47.371906 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:47.373042 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:47.374343 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:56:47.376438 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:56:47.376664 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.376940 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:56:47.377166 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260503 07:56:47.412875 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.2:37227
I20260503 07:56:47.412982 27531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.2:37227 every 8 connection(s)
I20260503 07:56:47.417093 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:56:47.423794 27535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:56:47.425447 27536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:47.428188 26792 server_base.cc:1061] running on GCE node
W20260503 07:56:47.428882 27538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:56:47.429324 27532 heartbeater.cc:344] Connected to a master server at 127.26.42.62:38993
I20260503 07:56:47.429718 27532 heartbeater.cc:461] Registering TS with master...
I20260503 07:56:47.430104 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:56:47.430331 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:56:47.430416 27532 heartbeater.cc:507] Master 127.26.42.62:38993 requested a full tablet report, sending...
I20260503 07:56:47.430505 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795007430490 us; error 0 us; skew 500 ppm
I20260503 07:56:47.431325 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:56:47.432602 27330 ts_manager.cc:194] Registered new tserver with Master: edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:47.433717 26792 webserver.cc:492] Webserver started at http://127.26.42.3:43727/ using document root <none> and password file <none>
I20260503 07:56:47.434065 27330 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39090
I20260503 07:56:47.434191 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:56:47.434464 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:56:47.434703 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:56:47.435815 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-2-root/instance:
uuid: "30f0efbda1d94993b988ef1bf97f041a"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.439965 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260503 07:56:47.443054 27543 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.443735 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260503 07:56:47.444123 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-2-root
uuid: "30f0efbda1d94993b988ef1bf97f041a"
format_stamp: "Formatted at 2026-05-03 07:56:47 on dist-test-slave-pd7x"
I20260503 07:56:47.444437 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1777794976273375-26792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:56:47.457384 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:56:47.458392 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:56:47.459648 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:56:47.461544 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:56:47.461750 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.461992 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:56:47.462167 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:56:47.497713 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.3:44853
I20260503 07:56:47.497800 27605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.3:44853 every 8 connection(s)
I20260503 07:56:47.509709 27606 heartbeater.cc:344] Connected to a master server at 127.26.42.62:38993
I20260503 07:56:47.510006 27606 heartbeater.cc:461] Registering TS with master...
I20260503 07:56:47.510614 27606 heartbeater.cc:507] Master 127.26.42.62:38993 requested a full tablet report, sending...
I20260503 07:56:47.512265 27330 ts_manager.cc:194] Registered new tserver with Master: 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:47.512674 26792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012009314s
I20260503 07:56:47.513533 27330 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39102
I20260503 07:56:47.534766 27330 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39104:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:56:47.537410 27330 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:56:47.602417 27422 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8e7861afc140569a3eac82c3ad5298 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260503 07:56:47.603817 27422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8e7861afc140569a3eac82c3ad5298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.604081 27421 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9ea551de184d4aa5385cd0567fe8cb (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260503 07:56:47.605329 27421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9ea551de184d4aa5385cd0567fe8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.610054 27420 tablet_service.cc:1511] Processing CreateTablet for tablet c290bb5d1fef4e119f2482704e43a3bb (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260503 07:56:47.611253 27420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c290bb5d1fef4e119f2482704e43a3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.613864 27419 tablet_service.cc:1511] Processing CreateTablet for tablet fb8d5201023e4347a732cecbc91a89be (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260503 07:56:47.615105 27419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8d5201023e4347a732cecbc91a89be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.616837 27418 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8adc2904324c3da1fc3edc9c45bfe8 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260503 07:56:47.618045 27418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8adc2904324c3da1fc3edc9c45bfe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.618971 27567 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8adc2904324c3da1fc3edc9c45bfe8 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260503 07:56:47.620250 27567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8adc2904324c3da1fc3edc9c45bfe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.620590 27566 tablet_service.cc:1511] Processing CreateTablet for tablet a3433376702e42bd966e7f1289ee7a8f (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260503 07:56:47.621853 27566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3433376702e42bd966e7f1289ee7a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.622197 27496 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9ea551de184d4aa5385cd0567fe8cb (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260503 07:56:47.623497 27496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9ea551de184d4aa5385cd0567fe8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.627017 27569 tablet_service.cc:1511] Processing CreateTablet for tablet c290bb5d1fef4e119f2482704e43a3bb (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260503 07:56:47.627094 27494 tablet_service.cc:1511] Processing CreateTablet for tablet fb8d5201023e4347a732cecbc91a89be (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260503 07:56:47.627980 27568 tablet_service.cc:1511] Processing CreateTablet for tablet fb8d5201023e4347a732cecbc91a89be (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260503 07:56:47.628436 27569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c290bb5d1fef4e119f2482704e43a3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.628255 27570 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9ea551de184d4aa5385cd0567fe8cb (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260503 07:56:47.629204 27568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8d5201023e4347a732cecbc91a89be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.630023 27493 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8adc2904324c3da1fc3edc9c45bfe8 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260503 07:56:47.630275 27492 tablet_service.cc:1511] Processing CreateTablet for tablet a3433376702e42bd966e7f1289ee7a8f (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260503 07:56:47.628463 27494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8d5201023e4347a732cecbc91a89be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.627059 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8e7861afc140569a3eac82c3ad5298 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260503 07:56:47.632220 27495 tablet_service.cc:1511] Processing CreateTablet for tablet c290bb5d1fef4e119f2482704e43a3bb (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260503 07:56:47.632344 27497 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8e7861afc140569a3eac82c3ad5298 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260503 07:56:47.632687 27492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3433376702e42bd966e7f1289ee7a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.627089 27417 tablet_service.cc:1511] Processing CreateTablet for tablet a3433376702e42bd966e7f1289ee7a8f (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260503 07:56:47.633497 27495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c290bb5d1fef4e119f2482704e43a3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.634310 27417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3433376702e42bd966e7f1289ee7a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.637684 27497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8e7861afc140569a3eac82c3ad5298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.641307 27493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8adc2904324c3da1fc3edc9c45bfe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.646289 27570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9ea551de184d4aa5385cd0567fe8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.649329 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8e7861afc140569a3eac82c3ad5298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.673204 27421 tablet_service.cc:1511] Processing CreateTablet for tablet af75dd9e3b4044a08068d80cbe7ef973 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260503 07:56:47.674751 27421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af75dd9e3b4044a08068d80cbe7ef973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.685727 27492 tablet_service.cc:1511] Processing CreateTablet for tablet af75dd9e3b4044a08068d80cbe7ef973 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260503 07:56:47.687040 27492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af75dd9e3b4044a08068d80cbe7ef973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.687872 27565 tablet_service.cc:1511] Processing CreateTablet for tablet af75dd9e3b4044a08068d80cbe7ef973 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260503 07:56:47.689049 27565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af75dd9e3b4044a08068d80cbe7ef973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.696612 27416 tablet_service.cc:1511] Processing CreateTablet for tablet 856866d07b0045bba33b54feb27d6840 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260503 07:56:47.697858 27416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856866d07b0045bba33b54feb27d6840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.703939 27495 tablet_service.cc:1511] Processing CreateTablet for tablet 856866d07b0045bba33b54feb27d6840 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260503 07:56:47.708129 27495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856866d07b0045bba33b54feb27d6840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.709050 27564 tablet_service.cc:1511] Processing CreateTablet for tablet 856866d07b0045bba33b54feb27d6840 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260503 07:56:47.710211 27564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856866d07b0045bba33b54feb27d6840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.735143 27620 tablet_bootstrap.cc:492] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:47.735368 27622 tablet_bootstrap.cc:492] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:47.754021 27622 tablet_bootstrap.cc:654] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.754043 27422 tablet_service.cc:1511] Processing CreateTablet for tablet c026f1c9631f476a97225a0f0ae8d717 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260503 07:56:47.755296 27422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c026f1c9631f476a97225a0f0ae8d717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.755266 27495 tablet_service.cc:1511] Processing CreateTablet for tablet c026f1c9631f476a97225a0f0ae8d717 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260503 07:56:47.756455 27495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c026f1c9631f476a97225a0f0ae8d717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.756980 27621 tablet_bootstrap.cc:492] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:47.765525 27564 tablet_service.cc:1511] Processing CreateTablet for tablet c026f1c9631f476a97225a0f0ae8d717 (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260503 07:56:47.766894 27564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c026f1c9631f476a97225a0f0ae8d717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.773463 27620 tablet_bootstrap.cc:654] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.777640 27419 tablet_service.cc:1511] Processing CreateTablet for tablet 5a4281d398da41fc9edd6d76c2fae30a (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260503 07:56:47.778779 27419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4281d398da41fc9edd6d76c2fae30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.782104 27571 tablet_service.cc:1511] Processing CreateTablet for tablet 5a4281d398da41fc9edd6d76c2fae30a (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260503 07:56:47.783239 27571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4281d398da41fc9edd6d76c2fae30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.791639 27622 tablet_bootstrap.cc:492] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:47.792205 27622 ts_tablet_manager.cc:1403] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.000s
I20260503 07:56:47.795706 27622 raft_consensus.cc:359] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.796537 27622 raft_consensus.cc:385] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.796841 27622 raft_consensus.cc:740] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.797933 27493 tablet_service.cc:1511] Processing CreateTablet for tablet 5a4281d398da41fc9edd6d76c2fae30a (DEFAULT_TABLE table=test-workload [id=7b3bb1ab31aa437ab7fc63d6143c7556]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260503 07:56:47.797772 27622 consensus_queue.cc:260] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.799057 27493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a4281d398da41fc9edd6d76c2fae30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:56:47.809875 27621 tablet_bootstrap.cc:654] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.812898 27622 ts_tablet_manager.cc:1434] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.020s user 0.011s sys 0.011s
I20260503 07:56:47.814167 27620 tablet_bootstrap.cc:492] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:47.814664 27620 ts_tablet_manager.cc:1403] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.080s user 0.018s sys 0.016s
I20260503 07:56:47.815269 27606 heartbeater.cc:499] Master 127.26.42.62:38993 was elected leader, sending a full tablet report...
I20260503 07:56:47.817499 27621 tablet_bootstrap.cc:492] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:47.817260 27620 raft_consensus.cc:359] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.817888 27620 raft_consensus.cc:385] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.818219 27620 raft_consensus.cc:740] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.817862 27621 ts_tablet_manager.cc:1403] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.001s
I20260503 07:56:47.818307 27622 tablet_bootstrap.cc:492] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:47.823239 27621 raft_consensus.cc:359] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.824045 27621 raft_consensus.cc:385] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.824383 27621 raft_consensus.cc:740] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.824955 27622 tablet_bootstrap.cc:654] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.825309 27621 consensus_queue.cc:260] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.835421 27621 ts_tablet_manager.cc:1434] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.017s user 0.007s sys 0.006s
I20260503 07:56:47.836172 27532 heartbeater.cc:499] Master 127.26.42.62:38993 was elected leader, sending a full tablet report...
I20260503 07:56:47.837982 27620 consensus_queue.cc:260] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.838981 27627 raft_consensus.cc:493] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:47.839524 27627 raft_consensus.cc:515] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.844905 27622 tablet_bootstrap.cc:492] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:47.845475 27622 ts_tablet_manager.cc:1403] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.004s
I20260503 07:56:47.848284 27622 raft_consensus.cc:359] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.849079 27622 raft_consensus.cc:385] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.849416 27622 raft_consensus.cc:740] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.850301 27622 consensus_queue.cc:260] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.852888 27622 ts_tablet_manager.cc:1434] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260503 07:56:47.853785 27622 tablet_bootstrap.cc:492] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:47.854480 27621 tablet_bootstrap.cc:492] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:47.857492 27627 leader_election.cc:290] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:47.860141 27622 tablet_bootstrap.cc:654] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.862604 27457 heartbeater.cc:499] Master 127.26.42.62:38993 was elected leader, sending a full tablet report...
I20260503 07:56:47.862342 27628 raft_consensus.cc:493] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:47.863481 27628 raft_consensus.cc:515] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.870757 27628 leader_election.cc:290] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:47.872185 27621 tablet_bootstrap.cc:654] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.876374 27620 ts_tablet_manager.cc:1434] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.061s user 0.031s sys 0.031s
I20260503 07:56:47.877262 27620 tablet_bootstrap.cc:492] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:47.882984 27620 tablet_bootstrap.cc:654] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.898423 27507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:47.899367 27507 raft_consensus.cc:2468] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 0.
I20260503 07:56:47.900590 27432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:47.900739 27396 leader_election.cc:304] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:47.901306 27432 raft_consensus.cc:2468] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 0.
I20260503 07:56:47.902318 27630 raft_consensus.cc:2804] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:47.902671 27630 raft_consensus.cc:493] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:47.902992 27630 raft_consensus.cc:3060] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:47.910732 27630 raft_consensus.cc:515] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.912602 27630 leader_election.cc:290] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:47.913370 27471 leader_election.cc:304] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:47.914206 27628 raft_consensus.cc:2804] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:47.914654 27628 raft_consensus.cc:493] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:47.914727 27507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:47.915146 27628 raft_consensus.cc:3060] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:47.926440 27628 raft_consensus.cc:515] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.927964 27507 raft_consensus.cc:2393] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 05a09fd797ae4b3fa5d100de0b16d623 in current term 1: Already voted for candidate edc591aa9b374b5985e7624f26a6a854 in this term.
I20260503 07:56:47.931475 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:47.933342 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:47.934190 27628 leader_election.cc:290] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:47.934489 27432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:47.934602 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
W20260503 07:56:47.935359 27471 leader_election.cc:343] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:56:47.935359 27396 leader_election.cc:343] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:47.935814 27432 raft_consensus.cc:2393] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edc591aa9b374b5985e7624f26a6a854 in current term 1: Already voted for candidate 05a09fd797ae4b3fa5d100de0b16d623 in this term.
W20260503 07:56:47.936869 27396 leader_election.cc:343] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:47.937403 27396 leader_election.cc:304] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623; no voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854
I20260503 07:56:47.938694 27630 raft_consensus.cc:2749] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:56:47.940512 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
W20260503 07:56:47.941725 27471 leader_election.cc:343] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:47.942194 27471 leader_election.cc:304] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edc591aa9b374b5985e7624f26a6a854; no voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a
I20260503 07:56:47.943285 27628 raft_consensus.cc:2749] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:56:47.944842 27622 tablet_bootstrap.cc:492] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:47.945328 27622 ts_tablet_manager.cc:1403] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.092s user 0.030s sys 0.039s
I20260503 07:56:47.945643 27621 tablet_bootstrap.cc:492] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:47.946120 27621 ts_tablet_manager.cc:1403] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.092s user 0.031s sys 0.023s
I20260503 07:56:47.946285 27620 tablet_bootstrap.cc:492] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:47.946698 27620 ts_tablet_manager.cc:1403] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.070s user 0.027s sys 0.017s
I20260503 07:56:47.948589 27620 raft_consensus.cc:359] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.949091 27620 raft_consensus.cc:385] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.949326 27620 raft_consensus.cc:740] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.949877 27620 consensus_queue.cc:260] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.949963 27622 raft_consensus.cc:359] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.950634 27622 raft_consensus.cc:385] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.950909 27622 raft_consensus.cc:740] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.951668 27620 ts_tablet_manager.cc:1434] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:56:47.951615 27622 consensus_queue.cc:260] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.952533 27620 tablet_bootstrap.cc:492] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:47.953802 27622 ts_tablet_manager.cc:1434] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260503 07:56:47.953665 27621 raft_consensus.cc:359] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.954303 27621 raft_consensus.cc:385] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.954567 27621 raft_consensus.cc:740] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.954689 27622 tablet_bootstrap.cc:492] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:47.955766 27621 consensus_queue.cc:260] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.957883 27621 ts_tablet_manager.cc:1434] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260503 07:56:47.958789 27621 tablet_bootstrap.cc:492] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:47.959328 27620 tablet_bootstrap.cc:654] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.960896 27622 tablet_bootstrap.cc:654] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.965166 27621 tablet_bootstrap.cc:654] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.970163 27620 tablet_bootstrap.cc:492] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:47.970610 27620 ts_tablet_manager.cc:1403] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.004s
I20260503 07:56:47.972349 27622 tablet_bootstrap.cc:492] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:47.972903 27622 ts_tablet_manager.cc:1403] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.006s
I20260503 07:56:47.973227 27620 raft_consensus.cc:359] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.973860 27620 raft_consensus.cc:385] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.974153 27620 raft_consensus.cc:740] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.974921 27620 consensus_queue.cc:260] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.975783 27622 raft_consensus.cc:359] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.976480 27622 raft_consensus.cc:385] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.976753 27622 raft_consensus.cc:740] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:47.977200 27620 ts_tablet_manager.cc:1434] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.006s user 0.001s sys 0.007s
I20260503 07:56:47.977593 27622 consensus_queue.cc:260] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.978102 27620 tablet_bootstrap.cc:492] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:47.979876 27622 ts_tablet_manager.cc:1434] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.007s user 0.001s sys 0.004s
I20260503 07:56:47.980798 27622 tablet_bootstrap.cc:492] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:47.984031 27620 tablet_bootstrap.cc:654] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.987190 27622 tablet_bootstrap.cc:654] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:47.995607 27621 tablet_bootstrap.cc:492] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:47.996160 27621 ts_tablet_manager.cc:1403] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.011s
I20260503 07:56:47.998507 27622 tablet_bootstrap.cc:492] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:47.998936 27622 ts_tablet_manager.cc:1403] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20260503 07:56:47.998875 27621 raft_consensus.cc:359] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:47.999655 27621 raft_consensus.cc:385] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:47.999898 27620 tablet_bootstrap.cc:492] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:47.999943 27621 raft_consensus.cc:740] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.000389 27620 ts_tablet_manager.cc:1403] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.012s
I20260503 07:56:48.001638 27622 raft_consensus.cc:359] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.002324 27622 raft_consensus.cc:385] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.002606 27622 raft_consensus.cc:740] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.000691 27621 consensus_queue.cc:260] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.002550 27620 raft_consensus.cc:359] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.003331 27620 raft_consensus.cc:385] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.003631 27620 raft_consensus.cc:740] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.003471 27622 consensus_queue.cc:260] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.004365 27620 consensus_queue.cc:260] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.004890 27621 ts_tablet_manager.cc:1434] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260503 07:56:48.005852 27621 tablet_bootstrap.cc:492] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:48.005914 27622 ts_tablet_manager.cc:1434] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260503 07:56:48.006850 27622 tablet_bootstrap.cc:492] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:48.008109 27620 ts_tablet_manager.cc:1434] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260503 07:56:48.009328 27620 tablet_bootstrap.cc:492] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:48.012240 27621 tablet_bootstrap.cc:654] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.012888 27622 tablet_bootstrap.cc:654] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.015067 27620 tablet_bootstrap.cc:654] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.021929 27622 tablet_bootstrap.cc:492] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:48.022485 27622 ts_tablet_manager.cc:1403] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260503 07:56:48.025883 27622 raft_consensus.cc:359] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.026837 27622 raft_consensus.cc:385] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.027199 27622 raft_consensus.cc:740] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.028661 27620 tablet_bootstrap.cc:492] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:48.029120 27620 ts_tablet_manager.cc:1403] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.004s
I20260503 07:56:48.029559 27622 consensus_queue.cc:260] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.030799 27621 tablet_bootstrap.cc:492] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:48.031296 27621 ts_tablet_manager.cc:1403] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.026s user 0.016s sys 0.008s
I20260503 07:56:48.031930 27622 ts_tablet_manager.cc:1434] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260503 07:56:48.031761 27620 raft_consensus.cc:359] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.032469 27620 raft_consensus.cc:385] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.032768 27620 raft_consensus.cc:740] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.032868 27622 tablet_bootstrap.cc:492] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:48.033581 27620 consensus_queue.cc:260] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.034245 27621 raft_consensus.cc:359] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.035037 27621 raft_consensus.cc:385] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.035394 27621 raft_consensus.cc:740] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.035959 27620 ts_tablet_manager.cc:1434] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:56:48.036273 27621 consensus_queue.cc:260] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.036862 27620 tablet_bootstrap.cc:492] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:48.038900 27621 ts_tablet_manager.cc:1434] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260503 07:56:48.039321 27622 tablet_bootstrap.cc:654] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.043287 27620 tablet_bootstrap.cc:654] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.052592 27621 tablet_bootstrap.cc:492] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:48.053407 27620 tablet_bootstrap.cc:492] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:48.053834 27620 ts_tablet_manager.cc:1403] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.003s
I20260503 07:56:48.058372 27620 raft_consensus.cc:359] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.059021 27620 raft_consensus.cc:385] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.059307 27620 raft_consensus.cc:740] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.060056 27620 consensus_queue.cc:260] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.061506 27621 tablet_bootstrap.cc:654] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.061710 27622 tablet_bootstrap.cc:492] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:48.062175 27622 ts_tablet_manager.cc:1403] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.016s
I20260503 07:56:48.062625 27620 ts_tablet_manager.cc:1434] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260503 07:56:48.063525 27620 tablet_bootstrap.cc:492] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:48.065021 27622 raft_consensus.cc:359] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.065896 27622 raft_consensus.cc:385] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.066253 27622 raft_consensus.cc:740] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.067251 27622 consensus_queue.cc:260] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.069605 27620 tablet_bootstrap.cc:654] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.073158 27621 tablet_bootstrap.cc:492] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:48.073637 27621 ts_tablet_manager.cc:1403] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.010s
I20260503 07:56:48.075048 27625 raft_consensus.cc:493] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.075496 27625 raft_consensus.cc:515] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.076910 27621 raft_consensus.cc:359] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.077664 27621 raft_consensus.cc:385] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.078027 27621 raft_consensus.cc:740] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.078852 27621 consensus_queue.cc:260] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.080323 27625 leader_election.cc:290] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.080801 27625 raft_consensus.cc:493] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.081224 27625 raft_consensus.cc:515] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.082952 27625 leader_election.cc:290] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.084870 27621 ts_tablet_manager.cc:1434] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260503 07:56:48.085255 27620 tablet_bootstrap.cc:492] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:48.085693 27620 ts_tablet_manager.cc:1403] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.007s
I20260503 07:56:48.086297 27621 tablet_bootstrap.cc:492] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:48.088337 27620 raft_consensus.cc:359] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.089074 27620 raft_consensus.cc:385] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.089378 27620 raft_consensus.cc:740] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.090150 27620 consensus_queue.cc:260] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.090639 27622 ts_tablet_manager.cc:1434] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260503 07:56:48.094749 27620 ts_tablet_manager.cc:1434] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260503 07:56:48.095623 27620 tablet_bootstrap.cc:492] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:48.095679 27622 tablet_bootstrap.cc:492] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:48.101972 27620 tablet_bootstrap.cc:654] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.107694 27625 raft_consensus.cc:493] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.108136 27625 raft_consensus.cc:515] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.109134 27620 tablet_bootstrap.cc:492] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:48.109166 27622 tablet_bootstrap.cc:654] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.109378 27432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.109607 27620 ts_tablet_manager.cc:1403] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.005s
I20260503 07:56:48.109994 27432 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.110234 27625 leader_election.cc:290] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.110925 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.108129 27621 tablet_bootstrap.cc:654] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.111594 27431 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.111991 27620 raft_consensus.cc:359] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.112581 27620 raft_consensus.cc:385] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.112839 27620 raft_consensus.cc:740] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.113193 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.113736 27431 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.113508 27620 consensus_queue.cc:260] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.114632 27545 leader_election.cc:304] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.115469 27545 leader_election.cc:304] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.116001 27625 raft_consensus.cc:2804] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.116289 27545 leader_election.cc:304] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.116657 27650 raft_consensus.cc:2804] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.116591 27625 raft_consensus.cc:493] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.117116 27650 raft_consensus.cc:493] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.117332 27625 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.117617 27650 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.119767 27622 tablet_bootstrap.cc:492] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:48.120155 27622 ts_tablet_manager.cc:1403] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.014s
I20260503 07:56:48.122450 27622 raft_consensus.cc:359] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.123023 27622 raft_consensus.cc:385] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.123308 27622 raft_consensus.cc:740] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.124056 27622 consensus_queue.cc:260] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.125769 27655 raft_consensus.cc:2804] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.126142 27655 raft_consensus.cc:493] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.126479 27655 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.128638 27625 raft_consensus.cc:515] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.128898 27650 raft_consensus.cc:515] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.130095 27620 ts_tablet_manager.cc:1434] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.020s user 0.003s sys 0.001s
I20260503 07:56:48.133162 27507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.133735 27507 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.134027 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.134410 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:48.134644 27505 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.134932 27431 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.135598 27625 leader_election.cc:290] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.135771 27620 tablet_bootstrap.cc:492] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:48.135670 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.138674 27432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:48.138839 27506 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.139184 27432 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.141718 27650 leader_election.cc:290] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.143394 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.143934 27505 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.144670 27620 tablet_bootstrap.cc:654] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.146106 27432 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
W20260503 07:56:48.146509 27377 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:56:48.146796 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.137943 27621 tablet_bootstrap.cc:492] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:48.147382 27506 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.147511 27621 ts_tablet_manager.cc:1403] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.009s
I20260503 07:56:48.148741 27622 ts_tablet_manager.cc:1434] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.028s user 0.007s sys 0.002s
I20260503 07:56:48.148880 27431 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
I20260503 07:56:48.149596 27622 tablet_bootstrap.cc:492] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:48.147521 27545 leader_election.cc:304] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.153219 27545 leader_election.cc:304] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.154089 27625 raft_consensus.cc:2804] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.154615 27625 raft_consensus.cc:697] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:48.155208 27622 tablet_bootstrap.cc:654] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.155581 27625 consensus_queue.cc:237] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.158012 27650 raft_consensus.cc:2804] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.163491 27655 raft_consensus.cc:515] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.165048 27506 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
I20260503 07:56:48.158457 27621 raft_consensus.cc:359] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.165890 27621 raft_consensus.cc:385] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.166146 27621 raft_consensus.cc:740] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.166543 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:48.166707 27621 consensus_queue.cc:260] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.167289 27431 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.168663 27621 ts_tablet_manager.cc:1434] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260503 07:56:48.169416 27655 leader_election.cc:290] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.172646 27505 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
I20260503 07:56:48.173607 27621 tablet_bootstrap.cc:492] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:48.184504 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.185284 27505 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.185362 27655 raft_consensus.cc:493] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.186069 27655 raft_consensus.cc:515] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.188419 27655 leader_election.cc:290] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.190474 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.190385 27432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.191568 27432 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.194974 27505 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
W20260503 07:56:48.195547 27545 leader_election.cc:343] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:48.197443 27545 leader_election.cc:304] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters: edc591aa9b374b5985e7624f26a6a854
I20260503 07:56:48.195842 27650 raft_consensus.cc:697] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:48.198945 27431 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
I20260503 07:56:48.199259 27650 consensus_queue.cc:237] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.201695 27621 tablet_bootstrap.cc:654] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.205672 27545 leader_election.cc:304] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:48.206619 27659 raft_consensus.cc:2804] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.207209 27620 tablet_bootstrap.cc:492] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:48.207621 27620 ts_tablet_manager.cc:1403] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.072s user 0.012s sys 0.024s
I20260503 07:56:48.207490 27659 raft_consensus.cc:493] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.208048 27659 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.208351 27621 tablet_bootstrap.cc:492] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:48.208776 27621 ts_tablet_manager.cc:1403] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.002s
I20260503 07:56:48.210124 27620 raft_consensus.cc:359] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.210709 27620 raft_consensus.cc:385] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.210951 27620 raft_consensus.cc:740] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.210894 27655 raft_consensus.cc:2804] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.211588 27655 raft_consensus.cc:697] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:48.211500 27621 raft_consensus.cc:359] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.212188 27621 raft_consensus.cc:385] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.212503 27621 raft_consensus.cc:740] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.212410 27655 consensus_queue.cc:237] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.214363 27621 consensus_queue.cc:260] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.215870 27620 consensus_queue.cc:260] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.216643 27621 ts_tablet_manager.cc:1434] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.008s user 0.003s sys 0.001s
I20260503 07:56:48.217559 27621 tablet_bootstrap.cc:492] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:48.217787 27620 ts_tablet_manager.cc:1434] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260503 07:56:48.219425 27620 tablet_bootstrap.cc:492] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623: Bootstrap starting.
I20260503 07:56:48.221443 27622 tablet_bootstrap.cc:492] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:48.221961 27622 ts_tablet_manager.cc:1403] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.073s user 0.027s sys 0.011s
I20260503 07:56:48.225111 27620 tablet_bootstrap.cc:654] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.225067 27622 raft_consensus.cc:359] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.226081 27622 raft_consensus.cc:385] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.226435 27622 raft_consensus.cc:740] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.233356 27630 raft_consensus.cc:493] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.233978 27630 raft_consensus.cc:515] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.236129 27630 leader_election.cc:290] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.236594 27620 tablet_bootstrap.cc:492] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623: No bootstrap required, opened a new log
I20260503 07:56:48.237082 27620 ts_tablet_manager.cc:1403] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent bootstrapping tablet: real 0.018s user 0.016s sys 0.000s
I20260503 07:56:48.237720 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.238004 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:48.238325 27505 raft_consensus.cc:2468] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 0.
I20260503 07:56:48.238562 27581 raft_consensus.cc:2468] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 0.
I20260503 07:56:48.239506 27396 leader_election.cc:304] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.239780 27620 raft_consensus.cc:359] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.240254 27630 raft_consensus.cc:2804] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.240710 27630 raft_consensus.cc:493] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.241192 27630 raft_consensus.cc:3060] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.242828 27621 tablet_bootstrap.cc:654] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.233325 27622 consensus_queue.cc:260] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.246032 27622 ts_tablet_manager.cc:1434] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260503 07:56:48.247277 27622 tablet_bootstrap.cc:492] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a: Bootstrap starting.
I20260503 07:56:48.248488 27630 raft_consensus.cc:515] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.246315 27620 raft_consensus.cc:385] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.249176 27620 raft_consensus.cc:740] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.250046 27630 leader_election.cc:290] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.249924 27620 consensus_queue.cc:260] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.251525 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:48.252097 27581 raft_consensus.cc:3060] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.251456 27328 catalog_manager.cc:5671] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 1 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:48.256152 27622 tablet_bootstrap.cc:654] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.252432 27620 ts_tablet_manager.cc:1434] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20260503 07:56:48.261446 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.262367 27505 raft_consensus.cc:3060] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.253301 27328 catalog_manager.cc:5671] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 1 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:48.267693 27622 tablet_bootstrap.cc:492] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a: No bootstrap required, opened a new log
I20260503 07:56:48.268144 27622 ts_tablet_manager.cc:1403] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.007s
I20260503 07:56:48.272419 27622 raft_consensus.cc:359] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.273124 27622 raft_consensus.cc:385] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.273419 27622 raft_consensus.cc:740] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.274099 27622 consensus_queue.cc:260] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.275892 27505 raft_consensus.cc:2468] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:48.276068 27622 ts_tablet_manager.cc:1434] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260503 07:56:48.274658 27581 raft_consensus.cc:2468] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:48.248489 27659 raft_consensus.cc:515] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.278044 27396 leader_election.cc:304] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.284611 27630 raft_consensus.cc:2804] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.285080 27630 raft_consensus.cc:697] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:48.285858 27630 consensus_queue.cc:237] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.286167 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.286479 27621 tablet_bootstrap.cc:492] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:48.287000 27621 ts_tablet_manager.cc:1403] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.070s user 0.021s sys 0.012s
W20260503 07:56:48.287361 27545 leader_election.cc:343] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:56:48.287850 27659 leader_election.cc:290] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.290102 27621 raft_consensus.cc:359] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.290882 27621 raft_consensus.cc:385] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.291121 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:48.291790 27431 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.297765 27431 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
I20260503 07:56:48.298848 27545 leader_election.cc:304] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters: edc591aa9b374b5985e7624f26a6a854
I20260503 07:56:48.291193 27621 raft_consensus.cc:740] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.299603 27659 raft_consensus.cc:2804] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.298475 27326 catalog_manager.cc:5671] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:48.302326 27659 raft_consensus.cc:697] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:48.302229 27621 consensus_queue.cc:260] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.303157 27659 consensus_queue.cc:237] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.304121 27621 ts_tablet_manager.cc:1434] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.017s user 0.003s sys 0.003s
I20260503 07:56:48.304956 27621 tablet_bootstrap.cc:492] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:48.307951 27328 catalog_manager.cc:5671] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 1 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:48.310075 27621 tablet_bootstrap.cc:654] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.315434 27621 tablet_bootstrap.cc:492] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:48.315785 27621 ts_tablet_manager.cc:1403] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260503 07:56:48.316000 27659 raft_consensus.cc:493] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.316468 27659 raft_consensus.cc:515] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.318296 27621 raft_consensus.cc:359] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.318866 27621 raft_consensus.cc:385] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.318877 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.319195 27621 raft_consensus.cc:740] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.319690 27431 raft_consensus.cc:2393] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f0efbda1d94993b988ef1bf97f041a in current term 1: Already voted for candidate 05a09fd797ae4b3fa5d100de0b16d623 in this term.
I20260503 07:56:48.319857 27621 consensus_queue.cc:260] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.320161 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.320888 27505 raft_consensus.cc:2393] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f0efbda1d94993b988ef1bf97f041a in current term 1: Already voted for candidate edc591aa9b374b5985e7624f26a6a854 in this term.
I20260503 07:56:48.321799 27621 ts_tablet_manager.cc:1434] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260503 07:56:48.322136 27545 leader_election.cc:304] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a; no voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854
I20260503 07:56:48.322633 27621 tablet_bootstrap.cc:492] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854: Bootstrap starting.
I20260503 07:56:48.322887 27650 raft_consensus.cc:3060] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.328023 27621 tablet_bootstrap.cc:654] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854: Neither blocks nor log segments found. Creating new log.
I20260503 07:56:48.329181 27650 raft_consensus.cc:2749] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:56:48.329499 27659 leader_election.cc:290] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.331724 27326 catalog_manager.cc:5671] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 1 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:48.333720 27621 tablet_bootstrap.cc:492] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854: No bootstrap required, opened a new log
I20260503 07:56:48.334102 27621 ts_tablet_manager.cc:1403] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260503 07:56:48.335973 27621 raft_consensus.cc:359] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.336407 27621 raft_consensus.cc:385] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:56:48.336611 27621 raft_consensus.cc:740] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Initialized, Role: FOLLOWER
I20260503 07:56:48.337158 27621 consensus_queue.cc:260] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.338860 27621 ts_tablet_manager.cc:1434] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260503 07:56:48.358757 27628 raft_consensus.cc:493] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.359122 27628 raft_consensus.cc:515] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.360572 27628 leader_election.cc:290] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.361246 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.361480 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:48.361748 27431 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 0.
I20260503 07:56:48.362099 27581 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 0.
I20260503 07:56:48.362694 27471 leader_election.cc:304] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:48.363389 27628 raft_consensus.cc:2804] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.363618 27628 raft_consensus.cc:493] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.363914 27628 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.367870 27628 raft_consensus.cc:515] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.369184 27628 leader_election.cc:290] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.369864 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:48.370011 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:48.370283 27431 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.370450 27581 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.374784 27431 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 1.
I20260503 07:56:48.374825 27581 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 1.
I20260503 07:56:48.375656 27471 leader_election.cc:304] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:48.376196 27628 raft_consensus.cc:2804] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.377239 27628 raft_consensus.cc:697] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 LEADER]: Becoming Leader. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:56:48.377938 27628 consensus_queue.cc:237] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.384317 27326 catalog_manager.cc:5671] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 reported cstate change: term changed from 0 to 1, leader changed from <none> to edc591aa9b374b5985e7624f26a6a854 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "edc591aa9b374b5985e7624f26a6a854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:48.401144 27659 raft_consensus.cc:493] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.401558 27659 raft_consensus.cc:515] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.403537 27659 leader_election.cc:290] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.405776 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.406467 27431 raft_consensus.cc:2468] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.406728 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.407428 27505 raft_consensus.cc:2468] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 0.
I20260503 07:56:48.407644 27545 leader_election.cc:304] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.408646 27659 raft_consensus.cc:2804] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.409055 27659 raft_consensus.cc:493] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.409564 27659 raft_consensus.cc:3060] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.415649 27659 raft_consensus.cc:515] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.417485 27659 leader_election.cc:290] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:48.418123 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:48.418340 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.418572 27431 raft_consensus.cc:3060] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.418800 27505 raft_consensus.cc:3060] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.422801 27431 raft_consensus.cc:2468] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
I20260503 07:56:48.422895 27505 raft_consensus.cc:2468] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 1.
I20260503 07:56:48.423655 27545 leader_election.cc:304] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.424345 27659 raft_consensus.cc:2804] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.424836 27659 raft_consensus.cc:697] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:48.425745 27659 consensus_queue.cc:237] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.433754 27326 catalog_manager.cc:5671] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 1 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:48.446041 27630 raft_consensus.cc:493] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.446458 27630 raft_consensus.cc:515] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.448112 27630 leader_election.cc:290] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.448557 27627 raft_consensus.cc:493] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.448987 27627 raft_consensus.cc:515] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.450675 27627 leader_election.cc:290] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.451725 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:48.452205 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:48.452322 27581 raft_consensus.cc:2468] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 0.
I20260503 07:56:48.452469 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.452811 27580 raft_consensus.cc:2468] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 0.
I20260503 07:56:48.452875 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:48.453047 27505 raft_consensus.cc:2468] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 0.
I20260503 07:56:48.453433 27506 raft_consensus.cc:2468] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 0.
I20260503 07:56:48.453971 27396 leader_election.cc:304] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:48.454689 27630 raft_consensus.cc:2804] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.455058 27630 raft_consensus.cc:493] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.455152 27396 leader_election.cc:304] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:48.455459 27630 raft_consensus.cc:3060] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.455862 27627 raft_consensus.cc:2804] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:56:48.456174 27627 raft_consensus.cc:493] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:48.456489 27627 raft_consensus.cc:3060] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.461903 27630 raft_consensus.cc:515] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.462697 27627 raft_consensus.cc:515] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.463721 27630 leader_election.cc:290] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.464461 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.464970 27506 raft_consensus.cc:3060] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.465204 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:48.465579 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:48.465765 27580 raft_consensus.cc:3060] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.466127 27505 raft_consensus.cc:3060] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.469201 27506 raft_consensus.cc:2468] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:48.470014 27627 leader_election.cc:290] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.470124 27396 leader_election.cc:304] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:48.470904 27627 raft_consensus.cc:2804] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.471388 27627 raft_consensus.cc:697] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:48.472044 27580 raft_consensus.cc:2468] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:48.471786 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:48.472167 27505 raft_consensus.cc:2468] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:48.472635 27581 raft_consensus.cc:3060] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.472951 27627 consensus_queue.cc:237] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.473287 27396 leader_election.cc:304] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:48.474115 27630 raft_consensus.cc:2804] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:56:48.475442 27630 raft_consensus.cc:697] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:48.476282 27630 consensus_queue.cc:237] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.478766 27581 raft_consensus.cc:2468] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:48.481563 27326 catalog_manager.cc:5671] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:48.493896 27326 catalog_manager.cc:5671] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:48.626766 27659 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.637634 27659 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.685735 27630 consensus_queue.cc:1048] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.694528 27630 consensus_queue.cc:1048] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.732769 27659 consensus_queue.cc:1048] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.735456 27659 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.749298 27659 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.749246 27650 consensus_queue.cc:1048] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.777760 27628 raft_consensus.cc:493] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:48.778110 27628 raft_consensus.cc:515] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:48.779366 27628 leader_election.cc:290] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:48.780128 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623" is_pre_election: true
I20260503 07:56:48.780388 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:48.780920 27431 raft_consensus.cc:2393] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edc591aa9b374b5985e7624f26a6a854 in current term 1: Already voted for candidate 30f0efbda1d94993b988ef1bf97f041a in this term.
I20260503 07:56:48.781796 27471 leader_election.cc:304] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edc591aa9b374b5985e7624f26a6a854; no voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a
I20260503 07:56:48.782367 27628 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:56:48.787016 27628 raft_consensus.cc:2749] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:56:48.811229 27650 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.821211 27650 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.823917 27650 consensus_queue.cc:1048] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.835420 27655 consensus_queue.cc:1048] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.891686 27628 consensus_queue.cc:1048] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.902137 27698 consensus_queue.cc:1048] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.940274 27630 consensus_queue.cc:1048] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.950255 27678 consensus_queue.cc:1048] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.967669 27678 consensus_queue.cc:1048] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:48.976684 27687 consensus_queue.cc:1048] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:56:49.147881 27377 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:56:49.526196 27627 raft_consensus.cc:493] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:56:49.526629 27627 raft_consensus.cc:515] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.528074 27627 leader_election.cc:290] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:49.528903 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854" is_pre_election: true
I20260503 07:56:49.529084 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a" is_pre_election: true
I20260503 07:56:49.529516 27505 raft_consensus.cc:2468] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:49.529633 27580 raft_consensus.cc:2468] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 1.
I20260503 07:56:49.530531 27396 leader_election.cc:304] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:49.531181 27627 raft_consensus.cc:2804] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:56:49.531489 27627 raft_consensus.cc:493] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:56:49.531757 27627 raft_consensus.cc:3060] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.536238 27627 raft_consensus.cc:515] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.537549 27627 leader_election.cc:290] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:49.538596 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:49.538930 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8e7861afc140569a3eac82c3ad5298" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:49.539219 27580 raft_consensus.cc:3060] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.539556 27505 raft_consensus.cc:3060] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.543661 27580 raft_consensus.cc:2468] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:49.544302 27505 raft_consensus.cc:2468] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:49.544598 27396 leader_election.cc:304] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:56:49.545316 27627 raft_consensus.cc:2804] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:49.545795 27627 raft_consensus.cc:697] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:49.546567 27627 consensus_queue.cc:237] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.553099 27328 catalog_manager.cc:5671] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 0 to 2, leader changed from <none> to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:49.753472 27580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:40598
I20260503 07:56:49.753931 27580 raft_consensus.cc:606] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:56:49.757824 27580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:40598
I20260503 07:56:49.758337 27580 raft_consensus.cc:606] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:56:49.764317 27580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:40598
I20260503 07:56:49.764873 27580 raft_consensus.cc:606] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:56:49.770766 27580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
mode: GRACEFUL
new_leader_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:40598
I20260503 07:56:49.771162 27580 raft_consensus.cc:606] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Received request to transfer leadership to TS edc591aa9b374b5985e7624f26a6a854
I20260503 07:56:49.775177 27580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "856866d07b0045bba33b54feb27d6840"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
mode: GRACEFUL
new_leader_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:40598
I20260503 07:56:49.775576 27580 raft_consensus.cc:606] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Received request to transfer leadership to TS edc591aa9b374b5985e7624f26a6a854
I20260503 07:56:49.786834 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:37636
I20260503 07:56:49.787365 27431 raft_consensus.cc:606] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Received request to transfer leadership to TS edc591aa9b374b5985e7624f26a6a854
I20260503 07:56:49.791481 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:37636
I20260503 07:56:49.791824 27431 raft_consensus.cc:606] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Received request to transfer leadership to TS 30f0efbda1d94993b988ef1bf97f041a
I20260503 07:56:49.810274 27659 raft_consensus.cc:993] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:56:49.810596 27650 raft_consensus.cc:1081] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:56:49.811657 27431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37628
I20260503 07:56:49.812023 27431 raft_consensus.cc:493] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:49.812299 27431 raft_consensus.cc:3060] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.816453 27431 raft_consensus.cc:515] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.817850 27431 leader_election.cc:290] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:49.818575 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:49.818913 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8adc2904324c3da1fc3edc9c45bfe8" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:49.819092 27505 raft_consensus.cc:3060] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.819410 27580 raft_consensus.cc:3055] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:49.819667 27580 raft_consensus.cc:740] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:49.820298 27580 consensus_queue.cc:260] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.821489 27580 raft_consensus.cc:3060] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.823879 27505 raft_consensus.cc:2468] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:49.824852 27396 leader_election.cc:304] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:49.825640 27627 raft_consensus.cc:2804] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:49.825831 27580 raft_consensus.cc:2468] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:49.826155 27627 raft_consensus.cc:697] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:49.826941 27627 consensus_queue.cc:237] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.832512 27328 catalog_manager.cc:5671] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 1 to 2, leader changed from 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:49.933506 27659 raft_consensus.cc:993] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:56:49.933915 27650 raft_consensus.cc:1081] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:56:49.935217 27431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37628
I20260503 07:56:49.935619 27431 raft_consensus.cc:493] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:49.935879 27431 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.940238 27431 raft_consensus.cc:515] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.941636 27431 leader_election.cc:290] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:49.942658 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:49.942966 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:49.943286 27580 raft_consensus.cc:3055] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:49.943553 27505 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.943699 27580 raft_consensus.cc:740] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:49.944489 27580 consensus_queue.cc:260] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.945667 27580 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.948652 27505 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:49.949492 27396 leader_election.cc:304] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:49.950219 27627 raft_consensus.cc:2804] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:49.950273 27580 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:49.950743 27627 raft_consensus.cc:697] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:49.951473 27627 consensus_queue.cc:237] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.957275 27328 catalog_manager.cc:5671] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 1 to 2, leader changed from 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:49.981139 27687 raft_consensus.cc:993] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:56:49.981487 27687 raft_consensus.cc:1081] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Signalling peer edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:56:49.982646 27505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:45624
I20260503 07:56:49.983023 27505 raft_consensus.cc:493] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:49.983300 27505 raft_consensus.cc:3060] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.987402 27505 raft_consensus.cc:515] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.988651 27505 leader_election.cc:290] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 2 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:49.989359 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:49.989674 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c026f1c9631f476a97225a0f0ae8d717" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:49.989830 27431 raft_consensus.cc:3055] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:49.990195 27431 raft_consensus.cc:740] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:49.990216 27580 raft_consensus.cc:3060] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.991170 27431 consensus_queue.cc:260] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:49.992368 27431 raft_consensus.cc:3060] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.992681 27627 raft_consensus.cc:993] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:56:49.993166 27687 raft_consensus.cc:1081] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Signalling peer 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:56:49.994377 27581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:40570
I20260503 07:56:49.994771 27581 raft_consensus.cc:493] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:49.995044 27581 raft_consensus.cc:3060] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:49.996553 27580 raft_consensus.cc:2468] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 2.
I20260503 07:56:49.997524 27471 leader_election.cc:304] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:49.998296 27628 raft_consensus.cc:2804] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:49.998526 27431 raft_consensus.cc:2468] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 2.
I20260503 07:56:49.999284 27628 raft_consensus.cc:697] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Becoming Leader. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:56:50.000080 27581 raft_consensus.cc:515] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.000156 27628 consensus_queue.cc:237] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.001920 27581 leader_election.cc:290] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 2 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:50.002446 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:50.003013 27431 raft_consensus.cc:3055] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:50.003322 27431 raft_consensus.cc:740] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:50.003530 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a4281d398da41fc9edd6d76c2fae30a" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:50.004103 27505 raft_consensus.cc:3060] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.003970 27431 consensus_queue.cc:260] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.004912 27431 raft_consensus.cc:3060] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.008073 27505 raft_consensus.cc:2468] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 2.
I20260503 07:56:50.008884 27545 leader_election.cc:304] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:50.009164 27431 raft_consensus.cc:2468] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 2.
I20260503 07:56:50.009687 27650 raft_consensus.cc:2804] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:50.010138 27650 raft_consensus.cc:697] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 2 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:50.010851 27650 consensus_queue.cc:237] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.012765 27328 catalog_manager.cc:5671] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 reported cstate change: term changed from 1 to 2, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to edc591aa9b374b5985e7624f26a6a854 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "edc591aa9b374b5985e7624f26a6a854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:50.017575 27325 catalog_manager.cc:5671] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 1 to 2, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 2 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:50.034385 27659 raft_consensus.cc:993] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:56:50.034777 27650 raft_consensus.cc:1081] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:56:50.035952 27431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37628
I20260503 07:56:50.036356 27431 raft_consensus.cc:493] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:50.036585 27431 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.040897 27431 raft_consensus.cc:515] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.042423 27431 leader_election.cc:290] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:50.043181 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:50.043355 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:50.043722 27505 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.043831 27581 raft_consensus.cc:3055] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:50.044152 27581 raft_consensus.cc:740] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:50.044853 27581 consensus_queue.cc:260] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.046020 27581 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.049980 27505 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:50.050909 27396 leader_election.cc:304] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:50.051677 27687 raft_consensus.cc:2804] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:50.052035 27687 raft_consensus.cc:697] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:50.052246 27581 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:56:50.052790 27687 consensus_queue.cc:237] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.055917 27659 raft_consensus.cc:993] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a: : Instructing follower edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:56:50.056372 27650 raft_consensus.cc:1081] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Signalling peer edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:56:50.057646 27505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:45638
I20260503 07:56:50.058012 27505 raft_consensus.cc:493] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:50.058300 27505 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.059923 27325 catalog_manager.cc:5671] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 1 to 2, leader changed from 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:50.061749 27505 raft_consensus.cc:515] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.062968 27505 leader_election.cc:290] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 2 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:50.063798 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:50.063988 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:50.064275 27431 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.064520 27581 raft_consensus.cc:3055] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:50.064864 27581 raft_consensus.cc:740] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:50.065572 27581 consensus_queue.cc:260] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.067564 27581 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.068966 27431 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 2.
I20260503 07:56:50.069897 27471 leader_election.cc:304] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:50.070617 27628 raft_consensus.cc:2804] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:50.070969 27628 raft_consensus.cc:697] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Becoming Leader. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:56:50.071659 27628 consensus_queue.cc:237] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.072522 27581 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 2.
I20260503 07:56:50.078012 27325 catalog_manager.cc:5671] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 reported cstate change: term changed from 1 to 2, leader changed from 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3) to edc591aa9b374b5985e7624f26a6a854 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "edc591aa9b374b5985e7624f26a6a854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:50.109659 27505 raft_consensus.cc:1275] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260503 07:56:50.110644 27687 consensus_queue.cc:1048] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:50.119813 27581 raft_consensus.cc:1275] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260503 07:56:50.120999 27687 consensus_queue.cc:1048] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:56:50.241616 27659 raft_consensus.cc:993] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a: : Instructing follower edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:56:50.241991 27650 raft_consensus.cc:1081] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Signalling peer edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:56:50.243249 27505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "856866d07b0045bba33b54feb27d6840"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:45638
I20260503 07:56:50.243667 27505 raft_consensus.cc:493] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:50.243922 27505 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.247887 27505 raft_consensus.cc:515] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.249208 27505 leader_election.cc:290] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 2 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:56:50.249866 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:50.250171 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:56:50.250358 27431 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.250675 27581 raft_consensus.cc:3055] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:56:50.250938 27581 raft_consensus.cc:740] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:50.251593 27581 consensus_queue.cc:260] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.252444 27581 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:56:50.254981 27431 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 2.
I20260503 07:56:50.255777 27471 leader_election.cc:304] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:50.256479 27628 raft_consensus.cc:2804] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:56:50.256851 27628 raft_consensus.cc:697] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Becoming Leader. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:56:50.257181 27581 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 2.
I20260503 07:56:50.257566 27628 consensus_queue.cc:237] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:50.263865 27328 catalog_manager.cc:5671] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 reported cstate change: term changed from 1 to 2, leader changed from 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3) to edc591aa9b374b5985e7624f26a6a854 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "edc591aa9b374b5985e7624f26a6a854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:56:50.332139 27581 raft_consensus.cc:1275] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.333366 27687 consensus_queue.cc:1048] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.337615 27505 raft_consensus.cc:1275] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.339213 27627 consensus_queue.cc:1048] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.387485 27505 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.388571 27687 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.390877 27431 raft_consensus.cc:1275] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.392047 27650 consensus_queue.cc:1048] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.396858 27581 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.398223 27687 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.410571 27505 raft_consensus.cc:1275] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.411767 27659 consensus_queue.cc:1048] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.465226 27581 raft_consensus.cc:1275] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.466317 27628 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.475293 27431 raft_consensus.cc:1275] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.476447 27734 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.490329 27581 raft_consensus.cc:1275] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.491283 27734 consensus_queue.cc:1048] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.498778 27431 raft_consensus.cc:1275] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.500424 27737 consensus_queue.cc:1048] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.640290 27506 raft_consensus.cc:1275] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.641430 27687 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.649089 27581 raft_consensus.cc:1275] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.650280 27687 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.661734 27431 raft_consensus.cc:1275] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.662757 27737 consensus_queue.cc:1048] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:50.670439 27581 raft_consensus.cc:1275] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:56:50.673749 27734 consensus_queue.cc:1048] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:56:52.820485 26792 auto_leader_rebalancer-test.cc:343] The leader distribution is
I20260503 07:56:52.821156 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:52.839057 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:36616
I20260503 07:56:52.839526 27431 raft_consensus.cc:606] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Received request to transfer leadership to TS 30f0efbda1d94993b988ef1bf97f041a
I20260503 07:56:52.841617 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:36616
I20260503 07:56:52.841965 27431 raft_consensus.cc:606] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Received request to transfer leadership to TS 30f0efbda1d94993b988ef1bf97f041a
I20260503 07:56:52.842717 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260503 07:56:52.843097 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:52.998715 27747 raft_consensus.cc:993] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:56:52.999197 27747 raft_consensus.cc:1081] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Signalling peer 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:56:53.000716 27581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:40570
I20260503 07:56:53.001240 27581 raft_consensus.cc:493] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:53.001590 27581 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:53.001737 27748 raft_consensus.cc:993] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:56:53.002210 27747 raft_consensus.cc:1081] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Signalling peer 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:56:53.003544 27580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:40570
I20260503 07:56:53.003978 27580 raft_consensus.cc:493] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:56:53.004261 27580 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:53.006636 27581 raft_consensus.cc:515] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:53.008106 27581 leader_election.cc:290] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 3 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:53.008700 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:53.008545 27580 raft_consensus.cc:515] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:53.009266 27431 raft_consensus.cc:3055] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:53.009156 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:53.009640 27431 raft_consensus.cc:740] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:53.009788 27506 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:53.010280 27431 consensus_queue.cc:260] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:53.010979 27432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:56:53.011268 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:56:53.011418 27431 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:53.011445 27432 raft_consensus.cc:3055] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:56:53.011741 27505 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:53.011893 27432 raft_consensus.cc:740] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:56:53.012677 27432 consensus_queue.cc:260] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:53.013715 27432 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:56:53.010358 27580 leader_election.cc:290] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 3 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:56:53.016935 27506 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 3.
I20260503 07:56:53.017205 27431 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 3.
I20260503 07:56:53.017589 27505 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 3.
I20260503 07:56:53.017961 27545 leader_election.cc:304] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:53.018872 27743 raft_consensus.cc:2804] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:53.019456 27432 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 3.
I20260503 07:56:53.019294 27545 leader_election.cc:304] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:56:53.020097 27743 raft_consensus.cc:697] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:53.021886 27749 raft_consensus.cc:2804] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:56:53.022078 27743 consensus_queue.cc:237] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:53.023070 27749 raft_consensus.cc:697] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:56:53.023741 27749 consensus_queue.cc:237] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:56:53.029316 27325 catalog_manager.cc:5671] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 2 to 3, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 3 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:53.041868 27325 catalog_manager.cc:5671] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 2 to 3, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 3 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:56:53.492545 27506 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:53.493695 27749 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:53.502534 27432 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:53.504161 27750 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:53.526774 27432 raft_consensus.cc:1275] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:53.527676 27749 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:53.534754 27506 raft_consensus.cc:1275] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:56:53.536339 27750 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:56:53.843880 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:53.849443 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:53.849742 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:54.850677 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:54.856654 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:54.856966 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:55.857728 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:55.862854 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:55.863185 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:56.864095 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:56.871654 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:56.872114 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:57.873169 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:57.877879 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:57.878166 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:58.878901 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:58.883926 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:58.884239 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:56:59.884963 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:56:59.889729 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:56:59.890027 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:00.890733 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:00.895623 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:00.895925 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:01.896605 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:01.901292 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:01.901611 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:02.926888 26792 auto_leader_rebalancer-test.cc:362] The leader distribution is
I20260503 07:57:02.933215 27580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:40598
I20260503 07:57:02.933733 27580 raft_consensus.cc:606] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:57:02.938413 27580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:40598
I20260503 07:57:02.938824 27580 raft_consensus.cc:606] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:57:02.956673 27506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:38882
I20260503 07:57:02.957168 27506 raft_consensus.cc:606] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:57:02.960985 27506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:38882
I20260503 07:57:02.961392 27506 raft_consensus.cc:606] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:57:02.964942 27506 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "856866d07b0045bba33b54feb27d6840"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
mode: GRACEFUL
new_leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:38882
I20260503 07:57:02.965348 27506 raft_consensus.cc:606] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Received request to transfer leadership to TS 05a09fd797ae4b3fa5d100de0b16d623
I20260503 07:57:03.063447 27775 raft_consensus.cc:993] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.064008 27771 raft_consensus.cc:1081] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.065269 27432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37628
I20260503 07:57:03.065618 27432 raft_consensus.cc:493] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:03.065838 27432 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:03.070089 27432 raft_consensus.cc:515] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.071825 27432 leader_election.cc:290] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 4 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:57:03.072558 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:57:03.072810 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a9ea551de184d4aa5385cd0567fe8cb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:57:03.073218 27506 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:03.073361 27580 raft_consensus.cc:3055] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:03.073670 27580 raft_consensus.cc:740] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:57:03.074370 27580 consensus_queue.cc:260] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.075582 27580 raft_consensus.cc:3060] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:03.077407 27506 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 4.
I20260503 07:57:03.078366 27396 leader_election.cc:304] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:57:03.079123 27767 raft_consensus.cc:2804] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:03.079957 27580 raft_consensus.cc:2468] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 4.
I20260503 07:57:03.080132 27767 raft_consensus.cc:697] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:03.081223 27767 consensus_queue.cc:237] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.087836 27326 catalog_manager.cc:5671] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 3 to 4, leader changed from 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:03.171612 27775 raft_consensus.cc:993] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.172072 27771 raft_consensus.cc:1081] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.173086 27432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37628
I20260503 07:57:03.173470 27432 raft_consensus.cc:493] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:03.173744 27432 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:03.177582 27432 raft_consensus.cc:515] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.178768 27432 leader_election.cc:290] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 4 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:57:03.179363 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:57:03.179577 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:57:03.179764 27506 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:03.180075 27580 raft_consensus.cc:3055] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:03.180306 27580 raft_consensus.cc:740] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:57:03.180802 27580 consensus_queue.cc:260] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.181502 27580 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:03.183499 27506 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 4.
I20260503 07:57:03.184283 27396 leader_election.cc:304] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:57:03.184948 27767 raft_consensus.cc:2804] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:03.185379 27767 raft_consensus.cc:697] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:03.185568 27580 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 4.
I20260503 07:57:03.186205 27767 consensus_queue.cc:237] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.192505 27326 catalog_manager.cc:5671] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 3 to 4, leader changed from 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:03.388125 27783 raft_consensus.cc:993] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.389540 27784 raft_consensus.cc:993] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.389617 27744 raft_consensus.cc:1081] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.390125 27784 raft_consensus.cc:1081] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.391346 27432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "856866d07b0045bba33b54feb27d6840"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37620
I20260503 07:57:03.391824 27432 raft_consensus.cc:493] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:03.392143 27432 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:03.392472 27431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37620
I20260503 07:57:03.392879 27431 raft_consensus.cc:493] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:03.393163 27431 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:03.396195 27432 raft_consensus.cc:515] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.397392 27432 leader_election.cc:290] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 3 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:57:03.398131 27506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:57:03.398343 27580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "856866d07b0045bba33b54feb27d6840" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:57:03.398592 27506 raft_consensus.cc:3055] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:03.397740 27431 raft_consensus.cc:515] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.398829 27580 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:03.398913 27506 raft_consensus.cc:740] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:57:03.400007 27431 leader_election.cc:290] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:57:03.399698 27506 consensus_queue.cc:260] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.400924 27506 raft_consensus.cc:3060] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:03.400986 27581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:57:03.401491 27581 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:03.401778 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:57:03.402238 27505 raft_consensus.cc:3055] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:03.402488 27505 raft_consensus.cc:740] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:57:03.403136 27505 consensus_queue.cc:260] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.404410 27505 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:03.404552 27580 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 3.
I20260503 07:57:03.405448 27396 leader_election.cc:304] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:57:03.406114 27767 raft_consensus.cc:2804] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:03.406558 27767 raft_consensus.cc:697] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:03.406805 27506 raft_consensus.cc:2468] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 3.
I20260503 07:57:03.407418 27767 consensus_queue.cc:237] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.408085 27581 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:57:03.408898 27396 leader_election.cc:304] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:57:03.409686 27776 raft_consensus.cc:2804] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:03.410948 27776 raft_consensus.cc:697] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:03.411798 27776 consensus_queue.cc:237] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.413259 27505 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 2.
I20260503 07:57:03.415411 27326 catalog_manager.cc:5671] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 2 to 3, leader changed from edc591aa9b374b5985e7624f26a6a854 (127.26.42.2) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 3 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:03.425489 27326 catalog_manager.cc:5671] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 1 to 2, leader changed from edc591aa9b374b5985e7624f26a6a854 (127.26.42.2) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:03.464591 27785 raft_consensus.cc:993] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854: : Instructing follower 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.464586 27581 raft_consensus.cc:1275] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:03.465015 27785 raft_consensus.cc:1081] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Signalling peer 05a09fd797ae4b3fa5d100de0b16d623 to start an election
I20260503 07:57:03.465938 27776 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:03.466572 27431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
from {username='slave'} at 127.0.0.1:37620
I20260503 07:57:03.466975 27431 raft_consensus.cc:493] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:03.467216 27431 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:03.472735 27431 raft_consensus.cc:515] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.475037 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:57:03.475545 27505 raft_consensus.cc:3055] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:03.475629 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "05a09fd797ae4b3fa5d100de0b16d623" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:57:03.475871 27505 raft_consensus.cc:740] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:57:03.476150 27579 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:03.476608 27505 consensus_queue.cc:260] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.477576 27505 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:03.474421 27431 leader_election.cc:290] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 3 election: Requested vote from peers edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:57:03.482403 27506 raft_consensus.cc:1275] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:03.484366 27579 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 3.
I20260503 07:57:03.484831 27505 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05a09fd797ae4b3fa5d100de0b16d623 in term 3.
I20260503 07:57:03.486112 27767 consensus_queue.cc:1048] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:03.486232 27396 leader_election.cc:304] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05a09fd797ae4b3fa5d100de0b16d623, 30f0efbda1d94993b988ef1bf97f041a; no voters:
I20260503 07:57:03.487699 27776 raft_consensus.cc:2804] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:03.488188 27776 raft_consensus.cc:697] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 LEADER]: Becoming Leader. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:03.488998 27776 consensus_queue.cc:237] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:03.496866 27325 catalog_manager.cc:5671] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 reported cstate change: term changed from 2 to 3, leader changed from edc591aa9b374b5985e7624f26a6a854 (127.26.42.2) to 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1). New cstate: current_term: 3 leader_uuid: "05a09fd797ae4b3fa5d100de0b16d623" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:03.601423 27579 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:03.602396 27776 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:03.609411 27505 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:03.610735 27767 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:03.828890 27579 raft_consensus.cc:1275] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:03.829901 27767 consensus_queue.cc:1048] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:03.837888 27505 raft_consensus.cc:1275] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:03.839128 27767 consensus_queue.cc:1048] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:03.843014 27579 raft_consensus.cc:1275] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:03.844549 27767 consensus_queue.cc:1048] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:03.859007 27505 raft_consensus.cc:1275] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:03.860070 27800 consensus_queue.cc:1048] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:04.072398 27579 raft_consensus.cc:1275] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:04.073380 27787 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:04.084229 27505 raft_consensus.cc:1275] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Refusing update from remote peer 05a09fd797ae4b3fa5d100de0b16d623: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:04.085341 27787 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:05.994860 26792 auto_leader_rebalancer-test.cc:377] The leader distribution is
I20260503 07:57:05.995441 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:06.001368 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:36616
I20260503 07:57:06.001771 27431 raft_consensus.cc:606] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Received request to transfer leadership to TS edc591aa9b374b5985e7624f26a6a854
I20260503 07:57:06.003788 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:36616
I20260503 07:57:06.004279 27431 raft_consensus.cc:606] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 LEADER]: Received request to transfer leadership to TS 30f0efbda1d94993b988ef1bf97f041a
I20260503 07:57:06.006541 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:36616
I20260503 07:57:06.006872 27431 raft_consensus.cc:606] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 LEADER]: Received request to transfer leadership to TS edc591aa9b374b5985e7624f26a6a854
I20260503 07:57:06.008452 27431 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be"
dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
mode: GRACEFUL
new_leader_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:36616
I20260503 07:57:06.008791 27431 raft_consensus.cc:606] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Received request to transfer leadership to TS 30f0efbda1d94993b988ef1bf97f041a
I20260503 07:57:06.009491 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260503 07:57:06.009881 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:06.082944 27776 raft_consensus.cc:993] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:57:06.083395 27787 raft_consensus.cc:1081] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Signalling peer 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:57:06.084573 27579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:40570
I20260503 07:57:06.084976 27579 raft_consensus.cc:493] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:06.085345 27579 raft_consensus.cc:3060] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:06.089711 27579 raft_consensus.cc:515] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.091672 27579 leader_election.cc:290] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 2 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:57:06.092553 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:57:06.092707 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8d5201023e4347a732cecbc91a89be" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:57:06.092990 27431 raft_consensus.cc:3055] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:06.093215 27505 raft_consensus.cc:3060] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:06.093322 27431 raft_consensus.cc:740] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:06.094003 27431 consensus_queue.cc:260] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.095120 27431 raft_consensus.cc:3060] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:06.098042 27505 raft_consensus.cc:2468] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 2.
I20260503 07:57:06.098905 27545 leader_election.cc:304] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:57:06.099395 27431 raft_consensus.cc:2468] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 2.
I20260503 07:57:06.099462 27771 raft_consensus.cc:2804] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:06.100754 27771 raft_consensus.cc:697] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 2 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:57:06.101531 27771 consensus_queue.cc:237] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.106981 27328 catalog_manager.cc:5671] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 1 to 2, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 2 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:06.158437 27776 raft_consensus.cc:993] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:57:06.158828 27787 raft_consensus.cc:1081] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 LEADER]: Signalling peer 30f0efbda1d94993b988ef1bf97f041a to start an election
I20260503 07:57:06.159871 27579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973"
dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
from {username='slave'} at 127.0.0.1:40570
I20260503 07:57:06.160262 27579 raft_consensus.cc:493] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:06.160526 27579 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:06.165484 27579 raft_consensus.cc:515] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.166833 27579 leader_election.cc:290] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 4 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227)
I20260503 07:57:06.167451 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:57:06.167764 27505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af75dd9e3b4044a08068d80cbe7ef973" candidate_uuid: "30f0efbda1d94993b988ef1bf97f041a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
I20260503 07:57:06.167933 27431 raft_consensus.cc:3055] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:06.168200 27505 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:06.168190 27431 raft_consensus.cc:740] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:06.168938 27431 consensus_queue.cc:260] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.169929 27431 raft_consensus.cc:3060] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:06.173645 27505 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 4.
I20260503 07:57:06.174527 27545 leader_election.cc:304] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:57:06.175114 27771 raft_consensus.cc:2804] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:06.175124 27431 raft_consensus.cc:2468] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f0efbda1d94993b988ef1bf97f041a in term 4.
I20260503 07:57:06.175660 27771 raft_consensus.cc:697] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 4 LEADER]: Becoming Leader. State: Replica: 30f0efbda1d94993b988ef1bf97f041a, State: Running, Role: LEADER
I20260503 07:57:06.176404 27771 consensus_queue.cc:237] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.181869 27328 catalog_manager.cc:5671] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a reported cstate change: term changed from 3 to 4, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3). New cstate: current_term: 4 leader_uuid: "30f0efbda1d94993b988ef1bf97f041a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:06.198937 27776 raft_consensus.cc:993] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:57:06.199312 27787 raft_consensus.cc:1081] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 LEADER]: Signalling peer edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:57:06.200532 27505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:45624
I20260503 07:57:06.200886 27505 raft_consensus.cc:493] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:06.201164 27505 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:06.204432 27505 raft_consensus.cc:515] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.206048 27505 leader_election.cc:290] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 5 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:57:06.206687 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:57:06.206938 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c290bb5d1fef4e119f2482704e43a3bb" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:57:06.207202 27431 raft_consensus.cc:3055] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:57:06.207439 27579 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:06.207517 27431 raft_consensus.cc:740] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:06.208159 27431 consensus_queue.cc:260] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.208882 27431 raft_consensus.cc:3060] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:06.211613 27579 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 5.
I20260503 07:57:06.212221 27431 raft_consensus.cc:2468] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 5.
I20260503 07:57:06.212612 27471 leader_election.cc:304] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:57:06.213204 27785 raft_consensus.cc:2804] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:57:06.214145 27785 raft_consensus.cc:697] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 5 LEADER]: Becoming Leader. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:57:06.214803 27785 consensus_queue.cc:237] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.222383 27328 catalog_manager.cc:5671] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 reported cstate change: term changed from 4 to 5, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to edc591aa9b374b5985e7624f26a6a854 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "edc591aa9b374b5985e7624f26a6a854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:06.299990 27787 raft_consensus.cc:993] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623: : Instructing follower edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:57:06.300365 27776 raft_consensus.cc:1081] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Signalling peer edc591aa9b374b5985e7624f26a6a854 to start an election
I20260503 07:57:06.301608 27505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f"
dest_uuid: "edc591aa9b374b5985e7624f26a6a854"
from {username='slave'} at 127.0.0.1:45624
I20260503 07:57:06.302032 27505 raft_consensus.cc:493] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:06.302268 27505 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:06.305943 27505 raft_consensus.cc:515] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.307138 27505 leader_election.cc:290] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 3 election: Requested vote from peers 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1:35101), 30f0efbda1d94993b988ef1bf97f041a (127.26.42.3:44853)
I20260503 07:57:06.307778 27431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05a09fd797ae4b3fa5d100de0b16d623"
I20260503 07:57:06.307973 27579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3433376702e42bd966e7f1289ee7a8f" candidate_uuid: "edc591aa9b374b5985e7624f26a6a854" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30f0efbda1d94993b988ef1bf97f041a"
I20260503 07:57:06.308259 27431 raft_consensus.cc:3055] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:06.308409 27579 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:06.308553 27431 raft_consensus.cc:740] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05a09fd797ae4b3fa5d100de0b16d623, State: Running, Role: LEADER
I20260503 07:57:06.309274 27431 consensus_queue.cc:260] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.310305 27431 raft_consensus.cc:3060] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:06.314399 27579 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 3.
I20260503 07:57:06.315310 27471 leader_election.cc:304] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f0efbda1d94993b988ef1bf97f041a, edc591aa9b374b5985e7624f26a6a854; no voters:
I20260503 07:57:06.315976 27785 raft_consensus.cc:2804] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:06.316124 27431 raft_consensus.cc:2468] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edc591aa9b374b5985e7624f26a6a854 in term 3.
I20260503 07:57:06.316439 27785 raft_consensus.cc:697] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 3 LEADER]: Becoming Leader. State: Replica: edc591aa9b374b5985e7624f26a6a854, State: Running, Role: LEADER
I20260503 07:57:06.317384 27785 consensus_queue.cc:237] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } }
I20260503 07:57:06.323915 27328 catalog_manager.cc:5671] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 reported cstate change: term changed from 2 to 3, leader changed from 05a09fd797ae4b3fa5d100de0b16d623 (127.26.42.1) to edc591aa9b374b5985e7624f26a6a854 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "edc591aa9b374b5985e7624f26a6a854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:06.508980 27431 raft_consensus.cc:1275] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:06.509932 27771 consensus_queue.cc:1048] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:06.520144 27505 raft_consensus.cc:1275] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:06.521801 27804 consensus_queue.cc:1048] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:06.610975 27579 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 5 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:57:06.612788 27785 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:57:06.625808 27431 raft_consensus.cc:1275] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 5 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:57:06.628773 27785 consensus_queue.cc:1048] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:06.699137 27505 raft_consensus.cc:1275] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:06.700100 27804 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "edc591aa9b374b5985e7624f26a6a854" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 37227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:06.710892 27431 raft_consensus.cc:1275] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Refusing update from remote peer 30f0efbda1d94993b988ef1bf97f041a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:06.712349 27824 consensus_queue.cc:1048] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:57:06.784937 27581 raft_consensus.cc:1275] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:06.786052 27821 consensus_queue.cc:1048] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f0efbda1d94993b988ef1bf97f041a" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:06.794854 27431 raft_consensus.cc:1275] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Refusing update from remote peer edc591aa9b374b5985e7624f26a6a854: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:06.796609 27811 consensus_queue.cc:1048] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05a09fd797ae4b3fa5d100de0b16d623" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 35101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:07.010767 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:07.015862 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:07.016144 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:08.017225 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:08.021986 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:08.022372 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:09.023119 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:09.028635 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:09.028980 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:10.029799 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:10.034814 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:10.035234 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:11.036121 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:11.041556 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:11.042061 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:12.042826 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:12.047724 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:12.048094 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:13.048817 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:13.053465 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:13.053838 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:14.054617 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:14.059347 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:14.059715 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:15.060562 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:15.065387 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260503 07:57:15.065716 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:16.091253 26792 auto_leader_rebalancer-test.cc:388] The leader distribution is
I20260503 07:57:16.091713 26792 tablet_server.cc:179] TabletServer@127.26.42.1:0 shutting down...
I20260503 07:57:16.119015 26792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260503 07:57:16.119613 26792 tablet_replica.cc:333] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.120173 26792 raft_consensus.cc:2243] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.120605 26792 raft_consensus.cc:2272] T 5a4281d398da41fc9edd6d76c2fae30a P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.122324 26792 tablet_replica.cc:333] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.122829 26792 raft_consensus.cc:2243] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.123257 26792 raft_consensus.cc:2272] T c026f1c9631f476a97225a0f0ae8d717 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.124755 26792 tablet_replica.cc:333] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.125250 26792 raft_consensus.cc:2243] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.125607 26792 raft_consensus.cc:2272] T fb8d5201023e4347a732cecbc91a89be P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.127076 26792 tablet_replica.cc:333] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.127468 26792 raft_consensus.cc:2243] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.127779 26792 raft_consensus.cc:2272] T af75dd9e3b4044a08068d80cbe7ef973 P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.129698 26792 tablet_replica.cc:333] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.130434 26792 raft_consensus.cc:2243] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.131287 26792 raft_consensus.cc:2272] T 3c8e7861afc140569a3eac82c3ad5298 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.132992 26792 tablet_replica.cc:333] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.133507 26792 raft_consensus.cc:2243] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.133916 26792 raft_consensus.cc:2272] T c290bb5d1fef4e119f2482704e43a3bb P 05a09fd797ae4b3fa5d100de0b16d623 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.135411 26792 tablet_replica.cc:333] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.135890 26792 raft_consensus.cc:2243] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.136567 26792 raft_consensus.cc:2272] T 856866d07b0045bba33b54feb27d6840 P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.138098 26792 tablet_replica.cc:333] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.138568 26792 raft_consensus.cc:2243] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.138942 26792 raft_consensus.cc:2272] T a3433376702e42bd966e7f1289ee7a8f P 05a09fd797ae4b3fa5d100de0b16d623 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.140475 26792 tablet_replica.cc:333] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.140900 26792 raft_consensus.cc:2243] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.141564 26792 raft_consensus.cc:2272] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 05a09fd797ae4b3fa5d100de0b16d623 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.143136 26792 tablet_replica.cc:333] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623: stopping tablet replica
I20260503 07:57:16.143484 26792 raft_consensus.cc:2243] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.144028 26792 raft_consensus.cc:2272] T 8a9ea551de184d4aa5385cd0567fe8cb P 05a09fd797ae4b3fa5d100de0b16d623 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.172322 26792 tablet_server.cc:196] TabletServer@127.26.42.1:0 shutdown complete.
I20260503 07:57:16.188460 26792 tablet_server.cc:179] TabletServer@127.26.42.2:0 shutting down...
W20260503 07:57:16.204816 27545 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260503 07:57:16.208635 27545 consensus_peers.cc:597] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a -> Peer edc591aa9b374b5985e7624f26a6a854 (127.26.42.2:37227): Couldn't send request to peer edc591aa9b374b5985e7624f26a6a854. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:16.212674 26792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260503 07:57:16.213289 26792 tablet_replica.cc:333] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.213914 26792 raft_consensus.cc:2243] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.214455 26792 raft_consensus.cc:2272] T 5a4281d398da41fc9edd6d76c2fae30a P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.216141 26792 tablet_replica.cc:333] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.216687 26792 raft_consensus.cc:2243] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 2 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.217392 26792 raft_consensus.cc:2272] T c026f1c9631f476a97225a0f0ae8d717 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.218803 26792 tablet_replica.cc:333] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.219265 26792 raft_consensus.cc:2243] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.219627 26792 raft_consensus.cc:2272] T fb8d5201023e4347a732cecbc91a89be P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.221156 26792 tablet_replica.cc:333] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.221603 26792 raft_consensus.cc:2243] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.221949 26792 raft_consensus.cc:2272] T 8a9ea551de184d4aa5385cd0567fe8cb P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.223452 26792 tablet_replica.cc:333] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.223887 26792 raft_consensus.cc:2243] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.224265 26792 raft_consensus.cc:2272] T 0e8adc2904324c3da1fc3edc9c45bfe8 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.225857 26792 tablet_replica.cc:333] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.226446 26792 raft_consensus.cc:2243] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.226862 26792 raft_consensus.cc:2272] T 856866d07b0045bba33b54feb27d6840 P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.228338 26792 tablet_replica.cc:333] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.228760 26792 raft_consensus.cc:2243] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 3 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.229435 26792 raft_consensus.cc:2272] T a3433376702e42bd966e7f1289ee7a8f P edc591aa9b374b5985e7624f26a6a854 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.230890 26792 tablet_replica.cc:333] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.231304 26792 raft_consensus.cc:2243] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.231674 26792 raft_consensus.cc:2272] T af75dd9e3b4044a08068d80cbe7ef973 P edc591aa9b374b5985e7624f26a6a854 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.233007 26792 tablet_replica.cc:333] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.233487 26792 raft_consensus.cc:2243] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 5 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.234117 26792 raft_consensus.cc:2272] T c290bb5d1fef4e119f2482704e43a3bb P edc591aa9b374b5985e7624f26a6a854 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.235520 26792 tablet_replica.cc:333] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854: stopping tablet replica
I20260503 07:57:16.235920 26792 raft_consensus.cc:2243] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.236284 26792 raft_consensus.cc:2272] T 3c8e7861afc140569a3eac82c3ad5298 P edc591aa9b374b5985e7624f26a6a854 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.262588 26792 tablet_server.cc:196] TabletServer@127.26.42.2:0 shutdown complete.
I20260503 07:57:16.278867 26792 tablet_server.cc:179] TabletServer@127.26.42.3:0 shutting down...
I20260503 07:57:16.302433 26792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260503 07:57:16.302953 26792 tablet_replica.cc:333] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.303498 26792 raft_consensus.cc:2243] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.303933 26792 raft_consensus.cc:2272] T c026f1c9631f476a97225a0f0ae8d717 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.305598 26792 tablet_replica.cc:333] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.306071 26792 raft_consensus.cc:2243] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 2 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.306742 26792 raft_consensus.cc:2272] T 5a4281d398da41fc9edd6d76c2fae30a P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.308168 26792 tablet_replica.cc:333] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.308622 26792 raft_consensus.cc:2243] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.308996 26792 raft_consensus.cc:2272] T a3433376702e42bd966e7f1289ee7a8f P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.310408 26792 tablet_replica.cc:333] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.310849 26792 raft_consensus.cc:2243] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.311216 26792 raft_consensus.cc:2272] T 856866d07b0045bba33b54feb27d6840 P 30f0efbda1d94993b988ef1bf97f041a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.312552 26792 tablet_replica.cc:333] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.312953 26792 raft_consensus.cc:2243] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.313346 26792 raft_consensus.cc:2272] T 3c8e7861afc140569a3eac82c3ad5298 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.314716 26792 tablet_replica.cc:333] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.315152 26792 raft_consensus.cc:2243] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.315523 26792 raft_consensus.cc:2272] T c290bb5d1fef4e119f2482704e43a3bb P 30f0efbda1d94993b988ef1bf97f041a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.316959 26792 tablet_replica.cc:333] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.317593 26792 raft_consensus.cc:2243] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 2 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.318324 26792 raft_consensus.cc:2272] T fb8d5201023e4347a732cecbc91a89be P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.319621 26792 tablet_replica.cc:333] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.320015 26792 raft_consensus.cc:2243] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 4 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.320576 26792 raft_consensus.cc:2272] T af75dd9e3b4044a08068d80cbe7ef973 P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.321973 26792 tablet_replica.cc:333] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.322365 26792 raft_consensus.cc:2243] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.322660 26792 raft_consensus.cc:2272] T 0e8adc2904324c3da1fc3edc9c45bfe8 P 30f0efbda1d94993b988ef1bf97f041a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.324033 26792 tablet_replica.cc:333] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a: stopping tablet replica
I20260503 07:57:16.324376 26792 raft_consensus.cc:2243] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:16.324683 26792 raft_consensus.cc:2272] T 8a9ea551de184d4aa5385cd0567fe8cb P 30f0efbda1d94993b988ef1bf97f041a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.351361 26792 tablet_server.cc:196] TabletServer@127.26.42.3:0 shutdown complete.
I20260503 07:57:16.368957 26792 master.cc:562] Master@127.26.42.62:38993 shutting down...
I20260503 07:57:16.388489 26792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 1 LEADER]: Raft consensus shutting down.
I20260503 07:57:16.388980 26792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:16.389344 26792 tablet_replica.cc:333] T 00000000000000000000000000000000 P 953fa9db3d39427d8b1713e12f48a7b4: stopping tablet replica
I20260503 07:57:16.409569 26792 master.cc:584] Master@127.26.42.62:38993 shutdown complete.
05a09fd797ae4b3fa5d100de0b16d623 5
30f0efbda1d94993b988ef1bf97f041a 1
edc591aa9b374b5985e7624f26a6a854 4
05a09fd797ae4b3fa5d100de0b16d623 3
30f0efbda1d94993b988ef1bf97f041a 3
edc591aa9b374b5985e7624f26a6a854 4
05a09fd797ae4b3fa5d100de0b16d623 8
30f0efbda1d94993b988ef1bf97f041a 1
edc591aa9b374b5985e7624f26a6a854 1
05a09fd797ae4b3fa5d100de0b16d623 4
30f0efbda1d94993b988ef1bf97f041a 3
edc591aa9b374b5985e7624f26a6a854 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29419 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260503 07:57:16.447053 26792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.42.62:41751
I20260503 07:57:16.448115 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:57:16.453157 27832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:57:16.453603 27833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:16.455121 26792 server_base.cc:1061] running on GCE node
W20260503 07:57:16.455368 27835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:16.456248 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:57:16.456420 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:57:16.456530 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795036456520 us; error 0 us; skew 500 ppm
I20260503 07:57:16.456940 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:57:16.459126 26792 webserver.cc:492] Webserver started at http://127.26.42.62:34449/ using document root <none> and password file <none>
I20260503 07:57:16.459486 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:57:16.459612 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:57:16.459794 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:57:16.460692 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/master-0-root/instance:
uuid: "07b43b33af274daa91d071dedcd4ed8b"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.464486 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260503 07:57:16.467329 27840 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.467994 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260503 07:57:16.468256 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/master-0-root
uuid: "07b43b33af274daa91d071dedcd4ed8b"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.468497 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:57:16.489353 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:57:16.490353 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:57:16.524010 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.62:41751
I20260503 07:57:16.524102 27891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.62:41751 every 8 connection(s)
I20260503 07:57:16.527545 27892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:16.536667 27892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Bootstrap starting.
I20260503 07:57:16.540814 27892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:16.544365 27892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: No bootstrap required, opened a new log
I20260503 07:57:16.546463 27892 raft_consensus.cc:359] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b43b33af274daa91d071dedcd4ed8b" member_type: VOTER }
I20260503 07:57:16.546840 27892 raft_consensus.cc:385] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:16.547012 27892 raft_consensus.cc:740] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b43b33af274daa91d071dedcd4ed8b, State: Initialized, Role: FOLLOWER
I20260503 07:57:16.547497 27892 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b43b33af274daa91d071dedcd4ed8b" member_type: VOTER }
I20260503 07:57:16.547883 27892 raft_consensus.cc:399] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260503 07:57:16.548072 27892 raft_consensus.cc:493] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260503 07:57:16.548250 27892 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:16.551678 27892 raft_consensus.cc:515] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b43b33af274daa91d071dedcd4ed8b" member_type: VOTER }
I20260503 07:57:16.552085 27892 leader_election.cc:304] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07b43b33af274daa91d071dedcd4ed8b; no voters:
I20260503 07:57:16.552995 27892 leader_election.cc:290] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260503 07:57:16.553393 27895 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:16.554553 27895 raft_consensus.cc:697] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [term 1 LEADER]: Becoming Leader. State: Replica: 07b43b33af274daa91d071dedcd4ed8b, State: Running, Role: LEADER
I20260503 07:57:16.555260 27895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b43b33af274daa91d071dedcd4ed8b" member_type: VOTER }
I20260503 07:57:16.555838 27892 sys_catalog.cc:565] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [sys.catalog]: configured and running, proceeding with master startup.
I20260503 07:57:16.558128 27896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07b43b33af274daa91d071dedcd4ed8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b43b33af274daa91d071dedcd4ed8b" member_type: VOTER } }
I20260503 07:57:16.558900 27896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [sys.catalog]: This master's current role is: LEADER
I20260503 07:57:16.558180 27897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07b43b33af274daa91d071dedcd4ed8b. Latest consensus state: current_term: 1 leader_uuid: "07b43b33af274daa91d071dedcd4ed8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b43b33af274daa91d071dedcd4ed8b" member_type: VOTER } }
I20260503 07:57:16.559407 27897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b [sys.catalog]: This master's current role is: LEADER
I20260503 07:57:16.561869 27901 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260503 07:57:16.566504 27901 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260503 07:57:16.570647 26792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260503 07:57:16.574541 27901 catalog_manager.cc:1357] Generated new cluster ID: cd21fdb9fbe7439da5ebf4cd76da24cd
I20260503 07:57:16.574795 27901 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260503 07:57:16.593492 27901 catalog_manager.cc:1380] Generated new certificate authority record
I20260503 07:57:16.594528 27901 catalog_manager.cc:1514] Loading token signing keys...
I20260503 07:57:16.608263 27901 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Generated new TSK 0
I20260503 07:57:16.608821 27901 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260503 07:57:16.637229 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:57:16.643510 27914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:57:16.644349 27915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:57:16.645442 27917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:16.646168 26792 server_base.cc:1061] running on GCE node
I20260503 07:57:16.646960 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:57:16.647145 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:57:16.647267 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795036647257 us; error 0 us; skew 500 ppm
I20260503 07:57:16.647692 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:57:16.650008 26792 webserver.cc:492] Webserver started at http://127.26.42.1:44041/ using document root <none> and password file <none>
I20260503 07:57:16.650434 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:57:16.650593 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:57:16.650813 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:57:16.651953 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/instance:
uuid: "37e72845941344c9b0aaa7235a6f4473"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.656041 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260503 07:57:16.659027 27922 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.659708 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260503 07:57:16.659960 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root
uuid: "37e72845941344c9b0aaa7235a6f4473"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.660188 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:57:16.693393 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:57:16.694526 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:57:16.695837 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:57:16.698009 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:57:16.698211 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.698462 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:57:16.698633 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.738695 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.1:34525
I20260503 07:57:16.738811 27984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.1:34525 every 8 connection(s)
I20260503 07:57:16.743919 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:57:16.751189 27989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:57:16.752456 27990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:16.754339 26792 server_base.cc:1061] running on GCE node
W20260503 07:57:16.754287 27992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:16.755889 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:57:16.756119 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:57:16.756289 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795036756266 us; error 0 us; skew 500 ppm
I20260503 07:57:16.756791 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:57:16.759028 26792 webserver.cc:492] Webserver started at http://127.26.42.2:45233/ using document root <none> and password file <none>
I20260503 07:57:16.759631 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:57:16.759876 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:57:16.760185 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:57:16.761819 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/instance:
uuid: "adaf84b6ac60420ab03d39b9db9f0413"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.762185 27985 heartbeater.cc:344] Connected to a master server at 127.26.42.62:41751
I20260503 07:57:16.762593 27985 heartbeater.cc:461] Registering TS with master...
I20260503 07:57:16.763425 27985 heartbeater.cc:507] Master 127.26.42.62:41751 requested a full tablet report, sending...
I20260503 07:57:16.765738 27857 ts_manager.cc:194] Registered new tserver with Master: 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:16.767226 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260503 07:57:16.768198 27857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33434
I20260503 07:57:16.771430 27997 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.772128 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260503 07:57:16.772454 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root
uuid: "adaf84b6ac60420ab03d39b9db9f0413"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.772699 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:57:16.787729 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:57:16.788764 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:57:16.790102 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:57:16.792066 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:57:16.792280 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.792507 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:57:16.792670 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.830211 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.2:41375
I20260503 07:57:16.830302 28059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.2:41375 every 8 connection(s)
I20260503 07:57:16.834726 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:57:16.842234 28063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:57:16.842442 28064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:16.845005 26792 server_base.cc:1061] running on GCE node
W20260503 07:57:16.846031 28066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:16.846640 28060 heartbeater.cc:344] Connected to a master server at 127.26.42.62:41751
I20260503 07:57:16.846882 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260503 07:57:16.846973 28060 heartbeater.cc:461] Registering TS with master...
W20260503 07:57:16.847128 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:57:16.847359 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795036847342 us; error 0 us; skew 500 ppm
I20260503 07:57:16.847841 28060 heartbeater.cc:507] Master 127.26.42.62:41751 requested a full tablet report, sending...
I20260503 07:57:16.847970 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:57:16.849678 27857 ts_manager.cc:194] Registered new tserver with Master: adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:16.850548 26792 webserver.cc:492] Webserver started at http://127.26.42.3:38725/ using document root <none> and password file <none>
I20260503 07:57:16.851007 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:57:16.851039 27857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33446
I20260503 07:57:16.851234 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:57:16.851605 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:57:16.852849 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/instance:
uuid: "be26cebb7c90445ea9a74f66463457c1"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.856833 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260503 07:57:16.859685 28071 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.860266 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260503 07:57:16.860647 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root
uuid: "be26cebb7c90445ea9a74f66463457c1"
format_stamp: "Formatted at 2026-05-03 07:57:16 on dist-test-slave-pd7x"
I20260503 07:57:16.860900 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:57:16.881165 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:57:16.882382 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:57:16.883699 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:57:16.885735 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:57:16.885958 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.886198 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:57:16.886370 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:16.924158 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.3:45643
I20260503 07:57:16.924266 28133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.3:45643 every 8 connection(s)
I20260503 07:57:16.936690 28134 heartbeater.cc:344] Connected to a master server at 127.26.42.62:41751
I20260503 07:57:16.937116 28134 heartbeater.cc:461] Registering TS with master...
I20260503 07:57:16.937798 28134 heartbeater.cc:507] Master 127.26.42.62:41751 requested a full tablet report, sending...
I20260503 07:57:16.939350 27857 ts_manager.cc:194] Registered new tserver with Master: be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:16.940411 26792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013312201s
I20260503 07:57:16.940454 27857 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33460
I20260503 07:57:16.963371 27857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33472:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260503 07:57:16.969882 27857 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260503 07:57:17.152225 28099 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1831fdfd114170b082b1c55dd3dd50 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260503 07:57:17.153700 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1831fdfd114170b082b1c55dd3dd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.154414 28025 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1831fdfd114170b082b1c55dd3dd50 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260503 07:57:17.155833 28025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1831fdfd114170b082b1c55dd3dd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.158241 28022 tablet_service.cc:1511] Processing CreateTablet for tablet 0a30bfd95aae43cd8f0fb4113f4b5452 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260503 07:57:17.159603 28022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a30bfd95aae43cd8f0fb4113f4b5452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.160490 28024 tablet_service.cc:1511] Processing CreateTablet for tablet 836271c3803e4270aeffc67aeb7df764 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260503 07:57:17.160758 28023 tablet_service.cc:1511] Processing CreateTablet for tablet cbc81e80292a4d5d9d661ff8d092c006 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260503 07:57:17.161793 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836271c3803e4270aeffc67aeb7df764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.162398 28023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc81e80292a4d5d9d661ff8d092c006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.162225 28021 tablet_service.cc:1511] Processing CreateTablet for tablet e04054c4bfe6478ca043dee547359d4e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260503 07:57:17.164351 28020 tablet_service.cc:1511] Processing CreateTablet for tablet 55c91f6091bd409db505153a1d4c7531 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260503 07:57:17.166213 28019 tablet_service.cc:1511] Processing CreateTablet for tablet bcdf11186a1e4eb99758f417d61dfd7a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260503 07:57:17.167479 28019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdf11186a1e4eb99758f417d61dfd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.171321 28017 tablet_service.cc:1511] Processing CreateTablet for tablet e7615e08909f47a2977e095a0e190c1e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260503 07:57:17.172508 28017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7615e08909f47a2977e095a0e190c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.174103 28016 tablet_service.cc:1511] Processing CreateTablet for tablet 9376e27fcb734be296a0612be76962b1 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260503 07:57:17.175232 28016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9376e27fcb734be296a0612be76962b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.177629 28018 tablet_service.cc:1511] Processing CreateTablet for tablet a2ab306b1af74c9ab53cebf8986a9e48 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260503 07:57:17.178792 28018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ab306b1af74c9ab53cebf8986a9e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.181802 28020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c91f6091bd409db505153a1d4c7531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.189306 28021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04054c4bfe6478ca043dee547359d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.190771 28149 tablet_bootstrap.cc:492] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:17.191298 28023 tablet_service.cc:1511] Processing CreateTablet for tablet fd5660140f2a4a67bee640fa37b03a74 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260503 07:57:17.192401 28023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5660140f2a4a67bee640fa37b03a74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.197165 28149 tablet_bootstrap.cc:654] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:17.206717 28149 tablet_bootstrap.cc:492] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:17.207193 28149 ts_tablet_manager.cc:1403] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.016s
I20260503 07:57:17.209908 28149 raft_consensus.cc:359] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.210893 28149 raft_consensus.cc:385] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:17.211252 28149 raft_consensus.cc:740] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:17.212069 28149 consensus_queue.cc:260] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.231444 28024 tablet_service.cc:1511] Processing CreateTablet for tablet a2c7e65c39c14ef9a8247a993905c0b6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260503 07:57:17.235152 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 836271c3803e4270aeffc67aeb7df764 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260503 07:57:17.236843 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836271c3803e4270aeffc67aeb7df764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.250718 28097 tablet_service.cc:1511] Processing CreateTablet for tablet cbc81e80292a4d5d9d661ff8d092c006 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260503 07:57:17.252043 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc81e80292a4d5d9d661ff8d092c006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.254134 28096 tablet_service.cc:1511] Processing CreateTablet for tablet 0a30bfd95aae43cd8f0fb4113f4b5452 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260503 07:57:17.255378 28096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a30bfd95aae43cd8f0fb4113f4b5452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.258049 28095 tablet_service.cc:1511] Processing CreateTablet for tablet e04054c4bfe6478ca043dee547359d4e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260503 07:57:17.259284 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04054c4bfe6478ca043dee547359d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.259164 28025 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260503 07:57:17.261077 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 55c91f6091bd409db505153a1d4c7531 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260503 07:57:17.262382 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c91f6091bd409db505153a1d4c7531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.262427 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c7e65c39c14ef9a8247a993905c0b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.266439 28092 tablet_service.cc:1511] Processing CreateTablet for tablet a2ab306b1af74c9ab53cebf8986a9e48 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260503 07:57:17.267946 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ab306b1af74c9ab53cebf8986a9e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.270068 28091 tablet_service.cc:1511] Processing CreateTablet for tablet e7615e08909f47a2977e095a0e190c1e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260503 07:57:17.271548 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7615e08909f47a2977e095a0e190c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.274248 28090 tablet_service.cc:1511] Processing CreateTablet for tablet 9376e27fcb734be296a0612be76962b1 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260503 07:57:17.275694 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9376e27fcb734be296a0612be76962b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.264645 28093 tablet_service.cc:1511] Processing CreateTablet for tablet bcdf11186a1e4eb99758f417d61dfd7a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260503 07:57:17.277704 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdf11186a1e4eb99758f417d61dfd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.289851 28060 heartbeater.cc:499] Master 127.26.42.62:41751 was elected leader, sending a full tablet report...
I20260503 07:57:17.296123 28020 tablet_service.cc:1511] Processing CreateTablet for tablet 107c0bcfce95420b89dc8b6dd201c7e9 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260503 07:57:17.301988 28151 tablet_bootstrap.cc:492] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:17.303498 28099 tablet_service.cc:1511] Processing CreateTablet for tablet fd5660140f2a4a67bee640fa37b03a74 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260503 07:57:17.337261 28025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.309751 27950 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1831fdfd114170b082b1c55dd3dd50 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260503 07:57:17.311648 27949 tablet_service.cc:1511] Processing CreateTablet for tablet 836271c3803e4270aeffc67aeb7df764 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260503 07:57:17.311905 28016 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecd0742bf5f466c8b6faa8b8c6708af (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260503 07:57:17.313215 27946 tablet_service.cc:1511] Processing CreateTablet for tablet e04054c4bfe6478ca043dee547359d4e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260503 07:57:17.316041 27944 tablet_service.cc:1511] Processing CreateTablet for tablet bcdf11186a1e4eb99758f417d61dfd7a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260503 07:57:17.318048 27947 tablet_service.cc:1511] Processing CreateTablet for tablet 0a30bfd95aae43cd8f0fb4113f4b5452 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260503 07:57:17.318842 27945 tablet_service.cc:1511] Processing CreateTablet for tablet 55c91f6091bd409db505153a1d4c7531 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260503 07:57:17.344924 27950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1831fdfd114170b082b1c55dd3dd50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.318049 27943 tablet_service.cc:1511] Processing CreateTablet for tablet a2ab306b1af74c9ab53cebf8986a9e48 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260503 07:57:17.319583 27942 tablet_service.cc:1511] Processing CreateTablet for tablet e7615e08909f47a2977e095a0e190c1e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260503 07:57:17.313215 27948 tablet_service.cc:1511] Processing CreateTablet for tablet cbc81e80292a4d5d9d661ff8d092c006 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260503 07:57:17.321624 27941 tablet_service.cc:1511] Processing CreateTablet for tablet 9376e27fcb734be296a0612be76962b1 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260503 07:57:17.300725 28023 tablet_service.cc:1511] Processing CreateTablet for tablet 90fb5d680ff149d8a9e1a217eb1877be (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260503 07:57:17.337720 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5660140f2a4a67bee640fa37b03a74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.340121 28151 tablet_bootstrap.cc:654] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:17.339959 28024 tablet_service.cc:1511] Processing CreateTablet for tablet 71fcd5bb1bc2480dbe59f5e131874dd1 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260503 07:57:17.306726 28098 tablet_service.cc:1511] Processing CreateTablet for tablet a2c7e65c39c14ef9a8247a993905c0b6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260503 07:57:17.341145 28149 ts_tablet_manager.cc:1434] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.134s user 0.021s sys 0.021s
I20260503 07:57:17.343622 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260503 07:57:17.347611 27949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836271c3803e4270aeffc67aeb7df764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.357399 27945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55c91f6091bd409db505153a1d4c7531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.354291 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c7e65c39c14ef9a8247a993905c0b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.354859 28016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecd0742bf5f466c8b6faa8b8c6708af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.362785 27942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7615e08909f47a2977e095a0e190c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.363359 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a30bfd95aae43cd8f0fb4113f4b5452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.369310 27946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04054c4bfe6478ca043dee547359d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.370253 28023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fb5d680ff149d8a9e1a217eb1877be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.374083 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9376e27fcb734be296a0612be76962b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.377458 27944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdf11186a1e4eb99758f417d61dfd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.381368 27943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ab306b1af74c9ab53cebf8986a9e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.383002 28149 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:17.390573 28016 tablet_service.cc:1511] Processing CreateTablet for tablet fa70a5c46ac143db96b5fa56b70d4170 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260503 07:57:17.391706 28016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa70a5c46ac143db96b5fa56b70d4170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.397289 28020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107c0bcfce95420b89dc8b6dd201c7e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.406206 27948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc81e80292a4d5d9d661ff8d092c006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.411413 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fcd5bb1bc2480dbe59f5e131874dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.412433 28022 tablet_service.cc:1511] Processing CreateTablet for tablet 35e5dcd66021442aa07a617dd72b8b56 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260503 07:57:17.413571 28022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e5dcd66021442aa07a617dd72b8b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.422194 28016 tablet_service.cc:1511] Processing CreateTablet for tablet ba53ed3bde024b3898c35255fe29cdae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260503 07:57:17.423661 28016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba53ed3bde024b3898c35255fe29cdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.430368 28021 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd4f1f94ce446d19045339767e2f84a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260503 07:57:17.431466 28021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd4f1f94ce446d19045339767e2f84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.388912 28149 tablet_bootstrap.cc:654] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:17.445585 28099 tablet_service.cc:1511] Processing CreateTablet for tablet 107c0bcfce95420b89dc8b6dd201c7e9 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260503 07:57:17.447643 28017 tablet_service.cc:1511] Processing CreateTablet for tablet 4029065128b84be9a45c0bfe2af75b6f (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260503 07:57:17.448465 28097 tablet_service.cc:1511] Processing CreateTablet for tablet 90fb5d680ff149d8a9e1a217eb1877be (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260503 07:57:17.449288 28017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4029065128b84be9a45c0bfe2af75b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.451432 28090 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecd0742bf5f466c8b6faa8b8c6708af (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260503 07:57:17.451584 28019 tablet_service.cc:1511] Processing CreateTablet for tablet 971ac26c5f9841959a1801eb548b0ff0 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260503 07:57:17.451843 28024 tablet_service.cc:1511] Processing CreateTablet for tablet b81225f6fe134f46a66b68b7b1656ec5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260503 07:57:17.453229 28019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971ac26c5f9841959a1801eb548b0ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.453173 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 71fcd5bb1bc2480dbe59f5e131874dd1 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260503 07:57:17.454054 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81225f6fe134f46a66b68b7b1656ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.460950 28018 tablet_service.cc:1511] Processing CreateTablet for tablet c2b5d5b5c52e455ca768d69be2c3e744 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260503 07:57:17.466539 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.482609 28154 tablet_bootstrap.cc:492] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:17.488495 28025 tablet_service.cc:1511] Processing CreateTablet for tablet 77488bc798a841d697b108fb23d5531b (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260503 07:57:17.496022 27944 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260503 07:57:17.496330 28093 tablet_service.cc:1511] Processing CreateTablet for tablet 971ac26c5f9841959a1801eb548b0ff0 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260503 07:57:17.500211 28151 tablet_bootstrap.cc:492] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:17.497068 28018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b5d5b5c52e455ca768d69be2c3e744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.500638 28151 ts_tablet_manager.cc:1403] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.199s user 0.024s sys 0.025s
I20260503 07:57:17.502010 28092 tablet_service.cc:1511] Processing CreateTablet for tablet fa70a5c46ac143db96b5fa56b70d4170 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260503 07:57:17.502066 28096 tablet_service.cc:1511] Processing CreateTablet for tablet ba53ed3bde024b3898c35255fe29cdae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260503 07:57:17.504274 27949 tablet_service.cc:1511] Processing CreateTablet for tablet 05a24a4ca75146cb8eb7f1b028582c15 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260503 07:57:17.500509 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107c0bcfce95420b89dc8b6dd201c7e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.506108 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa70a5c46ac143db96b5fa56b70d4170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.506731 27944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.508558 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fb5d680ff149d8a9e1a217eb1877be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.509289 28096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba53ed3bde024b3898c35255fe29cdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.513262 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971ac26c5f9841959a1801eb548b0ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.514072 27947 tablet_service.cc:1511] Processing CreateTablet for tablet 107c0bcfce95420b89dc8b6dd201c7e9 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260503 07:57:17.515311 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107c0bcfce95420b89dc8b6dd201c7e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.517293 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fcd5bb1bc2480dbe59f5e131874dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.519203 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecd0742bf5f466c8b6faa8b8c6708af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.520445 27941 tablet_service.cc:1511] Processing CreateTablet for tablet 90fb5d680ff149d8a9e1a217eb1877be (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260503 07:57:17.521672 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90fb5d680ff149d8a9e1a217eb1877be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.522851 27943 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecd0742bf5f466c8b6faa8b8c6708af (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260503 07:57:17.524009 27943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecd0742bf5f466c8b6faa8b8c6708af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.524631 28025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77488bc798a841d697b108fb23d5531b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.525269 27949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a24a4ca75146cb8eb7f1b028582c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.525525 27945 tablet_service.cc:1511] Processing CreateTablet for tablet fd5660140f2a4a67bee640fa37b03a74 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260503 07:57:17.530184 27946 tablet_service.cc:1511] Processing CreateTablet for tablet 71fcd5bb1bc2480dbe59f5e131874dd1 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260503 07:57:17.493590 27942 tablet_service.cc:1511] Processing CreateTablet for tablet a2c7e65c39c14ef9a8247a993905c0b6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260503 07:57:17.535125 28149 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:17.535570 28149 ts_tablet_manager.cc:1403] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.153s user 0.012s sys 0.002s
I20260503 07:57:17.536870 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 35e5dcd66021442aa07a617dd72b8b56 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260503 07:57:17.538022 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e5dcd66021442aa07a617dd72b8b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.541177 27946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fcd5bb1bc2480dbe59f5e131874dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.541697 27942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2c7e65c39c14ef9a8247a993905c0b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.550539 27950 tablet_service.cc:1511] Processing CreateTablet for tablet 971ac26c5f9841959a1801eb548b0ff0 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260503 07:57:17.551651 27950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971ac26c5f9841959a1801eb548b0ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.558316 28149 raft_consensus.cc:359] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.558950 28149 raft_consensus.cc:385] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:17.559218 28149 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:17.561290 27945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5660140f2a4a67bee640fa37b03a74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.564070 28016 tablet_service.cc:1511] Processing CreateTablet for tablet 5b75e8de5b4f4852a6c586b0a4bf99ba (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260503 07:57:17.565207 28016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b75e8de5b4f4852a6c586b0a4bf99ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:57:17.566345 27905 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:57:17.564070 28020 tablet_service.cc:1511] Processing CreateTablet for tablet 1aee73f7040c418fa1ef15f9d8b84c3c (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260503 07:57:17.569792 28154 tablet_bootstrap.cc:654] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:17.570181 28020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aee73f7040c418fa1ef15f9d8b84c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.570616 28023 tablet_service.cc:1511] Processing CreateTablet for tablet 05a24a4ca75146cb8eb7f1b028582c15 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260503 07:57:17.571091 28093 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd4f1f94ce446d19045339767e2f84a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260503 07:57:17.571888 28023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a24a4ca75146cb8eb7f1b028582c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.597786 28097 tablet_service.cc:1511] Processing CreateTablet for tablet 4029065128b84be9a45c0bfe2af75b6f (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260503 07:57:17.572237 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd4f1f94ce446d19045339767e2f84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.582741 28019 tablet_service.cc:1511] Processing CreateTablet for tablet 40656d9e0b58422a98512c2de8445e60 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260503 07:57:17.584339 28061 tablet.cc:2404] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260503 07:57:17.584932 27948 tablet_service.cc:1511] Processing CreateTablet for tablet fa70a5c46ac143db96b5fa56b70d4170 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260503 07:57:17.607547 27948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa70a5c46ac143db96b5fa56b70d4170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.608275 28090 tablet_service.cc:1511] Processing CreateTablet for tablet b81225f6fe134f46a66b68b7b1656ec5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260503 07:57:17.609576 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81225f6fe134f46a66b68b7b1656ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.612102 28017 tablet_service.cc:1511] Processing CreateTablet for tablet 98c37994a7bf4429b4fff0b9cf211dec (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260503 07:57:17.588143 28092 tablet_service.cc:1511] Processing CreateTablet for tablet cc5427ec15974579a114f5b1955ebc27 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260503 07:57:17.589963 28151 raft_consensus.cc:359] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:17.594360 27944 tablet_service.cc:1511] Processing CreateTablet for tablet ba53ed3bde024b3898c35255fe29cdae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260503 07:57:17.637727 28151 raft_consensus.cc:385] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:17.638048 28151 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:17.638288 27944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba53ed3bde024b3898c35255fe29cdae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.638695 28151 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:17.595150 27947 tablet_service.cc:1511] Processing CreateTablet for tablet 35e5dcd66021442aa07a617dd72b8b56 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260503 07:57:17.645732 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e5dcd66021442aa07a617dd72b8b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.585676 28149 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.650667 28149 ts_tablet_manager.cc:1434] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.115s user 0.001s sys 0.006s
I20260503 07:57:17.651513 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 05a24a4ca75146cb8eb7f1b028582c15 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260503 07:57:17.614053 28098 tablet_service.cc:1511] Processing CreateTablet for tablet 77488bc798a841d697b108fb23d5531b (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260503 07:57:17.615087 28024 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3f44c930db4ede8aff2abe0206edef (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260503 07:57:17.615736 28096 tablet_service.cc:1511] Processing CreateTablet for tablet 1aee73f7040c418fa1ef15f9d8b84c3c (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260503 07:57:17.615737 28154 tablet_bootstrap.cc:492] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:17.618921 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4029065128b84be9a45c0bfe2af75b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.618623 28022 tablet_service.cc:1511] Processing CreateTablet for tablet efcad53159b446a285a0bdf1f53a426e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260503 07:57:17.608289 28099 tablet_service.cc:1511] Processing CreateTablet for tablet c2b5d5b5c52e455ca768d69be2c3e744 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260503 07:57:17.651517 28149 tablet_bootstrap.cc:492] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:17.627252 27943 tablet_service.cc:1511] Processing CreateTablet for tablet 4029065128b84be9a45c0bfe2af75b6f (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260503 07:57:17.626765 27941 tablet_service.cc:1511] Processing CreateTablet for tablet 77488bc798a841d697b108fb23d5531b (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260503 07:57:17.628010 27949 tablet_service.cc:1511] Processing CreateTablet for tablet b81225f6fe134f46a66b68b7b1656ec5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260503 07:57:17.628793 27945 tablet_service.cc:1511] Processing CreateTablet for tablet 1aee73f7040c418fa1ef15f9d8b84c3c (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260503 07:57:17.676420 27943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4029065128b84be9a45c0bfe2af75b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.676172 28093 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3f44c930db4ede8aff2abe0206edef (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260503 07:57:17.677150 27945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aee73f7040c418fa1ef15f9d8b84c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.659240 28090 tablet_service.cc:1511] Processing CreateTablet for tablet 40656d9e0b58422a98512c2de8445e60 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260503 07:57:17.628773 27946 tablet_service.cc:1511] Processing CreateTablet for tablet c2b5d5b5c52e455ca768d69be2c3e744 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260503 07:57:17.681710 27946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b5d5b5c52e455ca768d69be2c3e744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.685501 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77488bc798a841d697b108fb23d5531b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.689266 27949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81225f6fe134f46a66b68b7b1656ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.629402 28025 tablet_service.cc:1511] Processing CreateTablet for tablet cc5427ec15974579a114f5b1955ebc27 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260503 07:57:17.630496 28018 tablet_service.cc:1511] Processing CreateTablet for tablet 28731014d42b4316af0150b0e98f6152 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260503 07:57:17.631578 28019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40656d9e0b58422a98512c2de8445e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.631659 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 5b75e8de5b4f4852a6c586b0a4bf99ba (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260503 07:57:17.633091 28021 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf3170afa5c43ddae7a0f830c5eb3dc (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260503 07:57:17.697090 28152 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:17.666064 28016 tablet_service.cc:1511] Processing CreateTablet for tablet 816629c788364a77be087fd62784f4de (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260503 07:57:17.697659 28152 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.700035 28152 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:17.626178 27950 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd4f1f94ce446d19045339767e2f84a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260503 07:57:17.661947 28154 ts_tablet_manager.cc:1403] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.180s user 0.011s sys 0.000s
I20260503 07:57:17.663120 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5427ec15974579a114f5b1955ebc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.703277 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b75e8de5b4f4852a6c586b0a4bf99ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.705369 28154 raft_consensus.cc:359] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.706025 28154 raft_consensus.cc:385] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:17.706290 28154 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:17.706974 28154 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.693712 28018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28731014d42b4316af0150b0e98f6152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.635566 28020 tablet_service.cc:1511] Processing CreateTablet for tablet eec1cba8286a4c81a9f66d33c805d337 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260503 07:57:17.672456 27942 tablet_service.cc:1511] Processing CreateTablet for tablet 5b75e8de5b4f4852a6c586b0a4bf99ba (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260503 07:57:17.675037 28023 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdf8a9cd6734a8ea93c12c8fcee5bd5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260503 07:57:17.702422 28134 heartbeater.cc:499] Master 127.26.42.62:41751 was elected leader, sending a full tablet report...
I20260503 07:57:17.721189 28017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c37994a7bf4429b4fff0b9cf211dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.725272 28021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf3170afa5c43ddae7a0f830c5eb3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.729130 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40656d9e0b58422a98512c2de8445e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.729735 27950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd4f1f94ce446d19045339767e2f84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.733256 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a24a4ca75146cb8eb7f1b028582c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.733708 28020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eec1cba8286a4c81a9f66d33c805d337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.667081 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 98c37994a7bf4429b4fff0b9cf211dec (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260503 07:57:17.736385 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c37994a7bf4429b4fff0b9cf211dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.737397 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3f44c930db4ede8aff2abe0206edef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.738463 28096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aee73f7040c418fa1ef15f9d8b84c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.739030 28025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5427ec15974579a114f5b1955ebc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.743350 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3f44c930db4ede8aff2abe0206edef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.750206 28151 ts_tablet_manager.cc:1434] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.248s user 0.024s sys 0.007s
I20260503 07:57:17.750358 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77488bc798a841d697b108fb23d5531b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.751420 28151 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:17.755456 27942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b75e8de5b4f4852a6c586b0a4bf99ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.761231 28023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdf8a9cd6734a8ea93c12c8fcee5bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.762028 28022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efcad53159b446a285a0bdf1f53a426e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.766564 27943 tablet_service.cc:1511] Processing CreateTablet for tablet 98c37994a7bf4429b4fff0b9cf211dec (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260503 07:57:17.767755 27943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98c37994a7bf4429b4fff0b9cf211dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.769251 28016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816629c788364a77be087fd62784f4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.771085 27985 heartbeater.cc:499] Master 127.26.42.62:41751 was elected leader, sending a full tablet report...
I20260503 07:57:17.804243 28024 tablet_service.cc:1511] Processing CreateTablet for tablet d17885e062854b2d81dab3f3e9f8b08b (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260503 07:57:17.805464 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17885e062854b2d81dab3f3e9f8b08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.810081 28093 tablet_service.cc:1511] Processing CreateTablet for tablet efcad53159b446a285a0bdf1f53a426e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260503 07:57:17.787923 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b5d5b5c52e455ca768d69be2c3e744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.818653 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efcad53159b446a285a0bdf1f53a426e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.784904 28152 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:17.821375 28152 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:17.823705 28152 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:17.835234 28090 tablet_service.cc:1511] Processing CreateTablet for tablet 28731014d42b4316af0150b0e98f6152 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260503 07:57:17.835390 27946 tablet_service.cc:1511] Processing CreateTablet for tablet efcad53159b446a285a0bdf1f53a426e (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260503 07:57:17.836437 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28731014d42b4316af0150b0e98f6152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.841238 28151 tablet_bootstrap.cc:654] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:17.858994 27950 tablet_service.cc:1511] Processing CreateTablet for tablet cc5427ec15974579a114f5b1955ebc27 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260503 07:57:17.836997 27946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efcad53159b446a285a0bdf1f53a426e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.842391 28154 ts_tablet_manager.cc:1434] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.139s user 0.008s sys 0.007s
I20260503 07:57:17.902457 28149 tablet_bootstrap.cc:654] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:17.858800 28025 tablet_service.cc:1511] Processing CreateTablet for tablet 16ae6a5bb3434187bcd46baf182a3cfd (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260503 07:57:17.990978 27950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc5427ec15974579a114f5b1955ebc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.991590 28025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ae6a5bb3434187bcd46baf182a3cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.907611 28097 tablet_service.cc:1511] Processing CreateTablet for tablet a77e35309a36413d8eaa064760e0e7ba (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260503 07:57:17.993588 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77e35309a36413d8eaa064760e0e7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.995422 28095 tablet_service.cc:1511] Processing CreateTablet for tablet 16ae6a5bb3434187bcd46baf182a3cfd (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260503 07:57:17.996661 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ae6a5bb3434187bcd46baf182a3cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.991266 28096 tablet_service.cc:1511] Processing CreateTablet for tablet 3b30e1a1065f4cd298949319438c2dae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260503 07:57:17.997783 28096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b30e1a1065f4cd298949319438c2dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.998967 28021 tablet_service.cc:1511] Processing CreateTablet for tablet 343a411e92a3469597c429025bfd0ba3 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260503 07:57:18.000156 28021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343a411e92a3469597c429025bfd0ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.004765 28159 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:17.866187 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 816629c788364a77be087fd62784f4de (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260503 07:57:18.005216 28159 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.006280 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816629c788364a77be087fd62784f4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.007592 28159 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:17.838821 28093 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf3170afa5c43ddae7a0f830c5eb3dc (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260503 07:57:18.013113 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf3170afa5c43ddae7a0f830c5eb3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.854687 28023 tablet_service.cc:1511] Processing CreateTablet for tablet a77e35309a36413d8eaa064760e0e7ba (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260503 07:57:17.892299 28018 tablet_service.cc:1511] Processing CreateTablet for tablet 426966c8fb5d49eea85d577d437e4252 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260503 07:57:17.877194 28092 tablet_service.cc:1511] Processing CreateTablet for tablet d17885e062854b2d81dab3f3e9f8b08b (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260503 07:57:17.853185 28024 tablet_service.cc:1511] Processing CreateTablet for tablet 3b30e1a1065f4cd298949319438c2dae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260503 07:57:17.859951 27942 tablet_service.cc:1511] Processing CreateTablet for tablet 28731014d42b4316af0150b0e98f6152 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260503 07:57:17.873785 28090 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdf8a9cd6734a8ea93c12c8fcee5bd5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260503 07:57:17.897380 27944 tablet_service.cc:1511] Processing CreateTablet for tablet 40656d9e0b58422a98512c2de8445e60 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260503 07:57:17.863900 28098 tablet_service.cc:1511] Processing CreateTablet for tablet eec1cba8286a4c81a9f66d33c805d337 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260503 07:57:17.870671 27943 tablet_service.cc:1511] Processing CreateTablet for tablet eec1cba8286a4c81a9f66d33c805d337 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260503 07:57:17.943637 27947 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdf8a9cd6734a8ea93c12c8fcee5bd5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260503 07:57:17.934793 28022 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc4931efc2a444c9fa25ec21c056196 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260503 07:57:17.924945 27941 tablet_service.cc:1511] Processing CreateTablet for tablet 816629c788364a77be087fd62784f4de (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260503 07:57:17.893047 27948 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3f44c930db4ede8aff2abe0206edef (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260503 07:57:17.895982 27945 tablet_service.cc:1511] Processing CreateTablet for tablet 0bf3170afa5c43ddae7a0f830c5eb3dc (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260503 07:57:18.034773 27950 tablet_service.cc:1511] Processing CreateTablet for tablet d17885e062854b2d81dab3f3e9f8b08b (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260503 07:57:18.033722 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17885e062854b2d81dab3f3e9f8b08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:17.928937 28019 tablet_service.cc:1511] Processing CreateTablet for tablet 57291cbb014449748e69000cc57c9e10 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260503 07:57:18.042182 28099 tablet_service.cc:1511] Processing CreateTablet for tablet 57291cbb014449748e69000cc57c9e10 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260503 07:57:18.058000 28097 tablet_service.cc:1511] Processing CreateTablet for tablet 426966c8fb5d49eea85d577d437e4252 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260503 07:57:18.059270 28092 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc4931efc2a444c9fa25ec21c056196 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260503 07:57:18.062193 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b30e1a1065f4cd298949319438c2dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.062839 28022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc4931efc2a444c9fa25ec21c056196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.069607 27942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28731014d42b4316af0150b0e98f6152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.070252 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdf8a9cd6734a8ea93c12c8fcee5bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.070808 28023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77e35309a36413d8eaa064760e0e7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.074440 28017 tablet_service.cc:1511] Processing CreateTablet for tablet 8a813d887a574b1f8a8be222ff2c07ae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260503 07:57:18.072829 27948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3f44c930db4ede8aff2abe0206edef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.073300 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57291cbb014449748e69000cc57c9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.078181 28022 tablet_service.cc:1511] Processing CreateTablet for tablet d4a767f631d84b75af79d3964f3a548f (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260503 07:57:18.106940 27949 tablet_service.cc:1511] Processing CreateTablet for tablet 3b30e1a1065f4cd298949319438c2dae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260503 07:57:18.038837 28154 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:18.095814 28017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a813d887a574b1f8a8be222ff2c07ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.121654 28157 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:18.122223 28157 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:18.123260 28094 tablet_service.cc:1511] Processing CreateTablet for tablet 343a411e92a3469597c429025bfd0ba3 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260503 07:57:18.126107 27943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eec1cba8286a4c81a9f66d33c805d337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.118121 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eec1cba8286a4c81a9f66d33c805d337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.137986 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816629c788364a77be087fd62784f4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.111326 28016 tablet_service.cc:1511] Processing CreateTablet for tablet f94961272bf04c3789c23577f7fec5eb (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260503 07:57:18.142781 28022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a767f631d84b75af79d3964f3a548f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.143306 28157 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:18.143216 27947 tablet_service.cc:1511] Processing CreateTablet for tablet a77e35309a36413d8eaa064760e0e7ba (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260503 07:57:18.146389 27950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17885e062854b2d81dab3f3e9f8b08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.148350 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a77e35309a36413d8eaa064760e0e7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.150398 28020 tablet_service.cc:1511] Processing CreateTablet for tablet 334bd7ff8fab4298882aa7841ab084e6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260503 07:57:18.155310 28016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94961272bf04c3789c23577f7fec5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.159508 28024 tablet_service.cc:1511] Processing CreateTablet for tablet 904abdfb5f89462c8a674a30012ffef3 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260503 07:57:18.160629 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904abdfb5f89462c8a674a30012ffef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.161201 28018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 426966c8fb5d49eea85d577d437e4252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.165609 28020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334bd7ff8fab4298882aa7841ab084e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.153916 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc4931efc2a444c9fa25ec21c056196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.169728 28097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 426966c8fb5d49eea85d577d437e4252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.172178 28090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdf8a9cd6734a8ea93c12c8fcee5bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.175032 28151 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.175484 28151 ts_tablet_manager.cc:1403] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.424s user 0.023s sys 0.010s
I20260503 07:57:18.177477 28025 tablet_service.cc:1511] Processing CreateTablet for tablet 648efe2729e74916af86a1421008e3c5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260503 07:57:18.179287 28025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648efe2729e74916af86a1421008e3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.181437 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343a411e92a3469597c429025bfd0ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.155036 27944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40656d9e0b58422a98512c2de8445e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.194392 28151 raft_consensus.cc:359] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.195102 28151 raft_consensus.cc:385] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.195392 28151 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.196058 28151 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.201277 27949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b30e1a1065f4cd298949319438c2dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.202443 28149 tablet_bootstrap.cc:492] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.202881 28149 ts_tablet_manager.cc:1403] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.552s user 0.012s sys 0.039s
I20260503 07:57:18.205327 27945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bf3170afa5c43ddae7a0f830c5eb3dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.213387 28019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57291cbb014449748e69000cc57c9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.218943 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 8a813d887a574b1f8a8be222ff2c07ae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260503 07:57:18.220114 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a813d887a574b1f8a8be222ff2c07ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.221768 28151 ts_tablet_manager.cc:1434] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.046s user 0.008s sys 0.000s
I20260503 07:57:18.222644 28151 tablet_bootstrap.cc:492] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.224602 28093 tablet_service.cc:1511] Processing CreateTablet for tablet d4a767f631d84b75af79d3964f3a548f (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260503 07:57:18.227172 28099 tablet_service.cc:1511] Processing CreateTablet for tablet 334bd7ff8fab4298882aa7841ab084e6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260503 07:57:18.222384 28095 tablet_service.cc:1511] Processing CreateTablet for tablet f94961272bf04c3789c23577f7fec5eb (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260503 07:57:18.228403 27946 tablet_service.cc:1511] Processing CreateTablet for tablet 16ae6a5bb3434187bcd46baf182a3cfd (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260503 07:57:18.229637 28149 raft_consensus.cc:359] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:18.231316 28022 tablet_service.cc:1511] Processing CreateTablet for tablet 48cbd9f468974e1db163ad369f5d7d11 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260503 07:57:18.230309 28149 raft_consensus.cc:385] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.232184 28149 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.232812 28149 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:18.236729 28096 tablet_service.cc:1511] Processing CreateTablet for tablet 904abdfb5f89462c8a674a30012ffef3 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260503 07:57:18.238350 27947 tablet_service.cc:1511] Processing CreateTablet for tablet 426966c8fb5d49eea85d577d437e4252 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260503 07:57:18.239532 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 426966c8fb5d49eea85d577d437e4252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.239919 28149 ts_tablet_manager.cc:1434] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.034s user 0.008s sys 0.000s
I20260503 07:57:18.240804 27946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ae6a5bb3434187bcd46baf182a3cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.246827 28095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94961272bf04c3789c23577f7fec5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.247571 28096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904abdfb5f89462c8a674a30012ffef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.249917 28022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cbd9f468974e1db163ad369f5d7d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.250494 28149 tablet_bootstrap.cc:492] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.250753 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334bd7ff8fab4298882aa7841ab084e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.252166 28093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a767f631d84b75af79d3964f3a548f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.260260 28149 tablet_bootstrap.cc:654] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.263994 27941 tablet_service.cc:1511] Processing CreateTablet for tablet 57291cbb014449748e69000cc57c9e10 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260503 07:57:18.270088 28020 tablet_service.cc:1511] Processing CreateTablet for tablet c3757a05a49e489386cdbf85d2f8e970 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260503 07:57:18.270305 28021 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb650978e344c697c44de57e4393e6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260503 07:57:18.276258 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57291cbb014449748e69000cc57c9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.276271 28021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb650978e344c697c44de57e4393e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.281594 28020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3757a05a49e489386cdbf85d2f8e970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.281514 28092 tablet_service.cc:1511] Processing CreateTablet for tablet 648efe2729e74916af86a1421008e3c5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260503 07:57:18.282785 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648efe2729e74916af86a1421008e3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.290108 28024 tablet_service.cc:1511] Processing CreateTablet for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260503 07:57:18.290947 28017 tablet_service.cc:1511] Processing CreateTablet for tablet 9196b781b73d42de863558f5a560cce2 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260503 07:57:18.297487 28017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9196b781b73d42de863558f5a560cce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.298198 28151 tablet_bootstrap.cc:654] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.299036 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 48cbd9f468974e1db163ad369f5d7d11 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260503 07:57:18.299281 27944 tablet_service.cc:1511] Processing CreateTablet for tablet 343a411e92a3469597c429025bfd0ba3 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260503 07:57:18.300215 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cbd9f468974e1db163ad369f5d7d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.301304 28024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.296242 28021 tablet_service.cc:1511] Processing CreateTablet for tablet e28b4630c47646428fe7dd12f35f482a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260503 07:57:18.300498 27944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343a411e92a3469597c429025bfd0ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.322154 27941 tablet_service.cc:1511] Processing CreateTablet for tablet 8a813d887a574b1f8a8be222ff2c07ae (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260503 07:57:18.324321 27947 tablet_service.cc:1511] Processing CreateTablet for tablet f94961272bf04c3789c23577f7fec5eb (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260503 07:57:18.328244 28099 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb650978e344c697c44de57e4393e6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260503 07:57:18.329422 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb650978e344c697c44de57e4393e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.364647 28154 tablet_bootstrap.cc:654] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.370608 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94961272bf04c3789c23577f7fec5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.372653 28021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28b4630c47646428fe7dd12f35f482a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.381868 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:18.398643 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:18.399296 28035 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:18.400590 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:18.401407 28157 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:18.401724 28157 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:18.401993 28157 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.408749 28149 tablet_bootstrap.cc:492] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.411054 28149 ts_tablet_manager.cc:1403] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.161s user 0.024s sys 0.018s
W20260503 07:57:18.413504 27924 leader_election.cc:343] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.417207 27948 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45162 (request call id 31) took 1087 ms. Trace:
I20260503 07:57:18.417603 27948 rpcz_store.cc:276] 0503 07:57:17.329661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:17.832731 (+503070us) service_pool.cc:224] Handling call
0503 07:57:18.072248 (+239517us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b5800000998. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f8509766ef1 00007f8509744183 00007f85096f2ac0 00007f8502b68bf4 00007f8502b68b82 00007f8502b68ab1
0503 07:57:18.072371 (+ 123us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:57:18.072461 (+ 90us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:57:18.243989 (+171528us) tablet_metadata.cc:665] Metadata flushed
0503 07:57:18.416743 (+172754us) tablet_replica.cc:206] Creating consensus instance
0503 07:57:18.417155 (+ 412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9806208}
I20260503 07:57:18.419970 27948 tablet_service.cc:1511] Processing CreateTablet for tablet 334bd7ff8fab4298882aa7841ab084e6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260503 07:57:18.396595 27943 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45162 (request call id 36) took 1026 ms. Trace:
I20260503 07:57:18.421360 27943 rpcz_store.cc:276] 0503 07:57:17.358805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:17.869619 (+510814us) service_pool.cc:224] Handling call
0503 07:57:18.074796 (+205177us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:57:18.074881 (+ 85us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:57:18.200067 (+125186us) tablet_metadata.cc:665] Metadata flushed
0503 07:57:18.384553 (+184486us) tablet_replica.cc:206] Creating consensus instance
0503 07:57:18.384967 (+ 414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353280}
I20260503 07:57:18.423333 27943 tablet_service.cc:1511] Processing CreateTablet for tablet 904abdfb5f89462c8a674a30012ffef3 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260503 07:57:18.369571 28094 tablet_service.cc:1511] Processing CreateTablet for tablet c3757a05a49e489386cdbf85d2f8e970 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260503 07:57:18.386809 28092 tablet_service.cc:1511] Processing CreateTablet for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260503 07:57:18.425261 28094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3757a05a49e489386cdbf85d2f8e970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.388303 28091 tablet_service.cc:1511] Processing CreateTablet for tablet 9196b781b73d42de863558f5a560cce2 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260503 07:57:18.390347 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:18.425812 27842 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 44264.8us
I20260503 07:57:18.426944 28091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9196b781b73d42de863558f5a560cce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.390475 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:18.391202 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:18.391324 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:18.391500 27950 tablet_service.cc:1511] Processing CreateTablet for tablet 1fc4931efc2a444c9fa25ec21c056196 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260503 07:57:18.392432 28098 tablet_service.cc:1511] Processing CreateTablet for tablet e28b4630c47646428fe7dd12f35f482a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260503 07:57:18.395692 27946 tablet_service.cc:1511] Processing CreateTablet for tablet d4a767f631d84b75af79d3964f3a548f (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260503 07:57:18.430370 28092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.430521 28157 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:18.428967 28107 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:18.413815 28149 raft_consensus.cc:359] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.438752 27944 tablet_service.cc:1511] Processing CreateTablet for tablet 648efe2729e74916af86a1421008e3c5 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260503 07:57:18.440156 27942 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45162 (request call id 34) took 1107 ms. Trace:
I20260503 07:57:18.440551 28151 tablet_bootstrap.cc:492] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.440996 27945 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45162 (request call id 35) took 1083 ms. Trace:
I20260503 07:57:18.442623 27948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334bd7ff8fab4298882aa7841ab084e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.471490 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:18.471228 27945 rpcz_store.cc:276] 0503 07:57:17.357935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:17.876749 (+518814us) service_pool.cc:224] Handling call
0503 07:57:18.045508 (+168759us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5800000998. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f8509766ef1 00007f8509744183 00007f85096f2ac0 00007f8502b68bf4 00007f8502b68b82 00007f8502b68ab1
0503 07:57:18.074657 (+ 29149us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:57:18.075049 (+ 392us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:57:18.363981 (+288932us) tablet_metadata.cc:665] Metadata flushed
0503 07:57:18.434728 (+ 70747us) tablet_replica.cc:206] Creating consensus instance
0503 07:57:18.440947 (+ 6219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7817216}
I20260503 07:57:18.472594 27944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648efe2729e74916af86a1421008e3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.472766 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:18.473203 28073 leader_election.cc:343] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.473944 27950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fc4931efc2a444c9fa25ec21c056196. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:57:18.443820 27999 leader_election.cc:343] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:18.474960 27999 leader_election.cc:343] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.475366 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:18.476183 28152 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:18.477367 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:18.485747 28152 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:18.486090 28152 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:18.486378 28152 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.454923 28154 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:18.487268 28154 ts_tablet_manager.cc:1403] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.455s user 0.013s sys 0.008s
I20260503 07:57:18.489882 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:18.489940 27944 tablet_service.cc:1511] Processing CreateTablet for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260503 07:57:18.490490 28035 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.491559 27950 tablet_service.cc:1511] Processing CreateTablet for tablet 9196b781b73d42de863558f5a560cce2 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260503 07:57:18.492451 28152 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.460700 28098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28b4630c47646428fe7dd12f35f482a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.463996 27949 tablet_service.cc:1511] Processing CreateTablet for tablet 48cbd9f468974e1db163ad369f5d7d11 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260503 07:57:18.466398 28157 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:18.494441 28152 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:18.497267 27999 leader_election.cc:343] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.498795 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:18.498975 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:18.499090 28035 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:18.499531 28107 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.500531 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:18.501600 28157 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:18.501726 27948 tablet_service.cc:1511] Processing CreateTablet for tablet e28b4630c47646428fe7dd12f35f482a (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260503 07:57:18.470558 28151 ts_tablet_manager.cc:1403] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.248s user 0.024s sys 0.027s
I20260503 07:57:18.506752 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:18.507076 28107 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:18.507820 28151 raft_consensus.cc:359] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.508571 28151 raft_consensus.cc:385] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.508893 28151 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.509315 28154 raft_consensus.cc:359] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.510015 28154 raft_consensus.cc:385] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.477973 27945 tablet_service.cc:1511] Processing CreateTablet for tablet c3757a05a49e489386cdbf85d2f8e970 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260503 07:57:18.481299 28073 leader_election.cc:343] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.482399 27947 tablet_service.cc:1511] Processing CreateTablet for tablet d9cb650978e344c697c44de57e4393e6 (DEFAULT_TABLE table=test-workload [id=8876eb8454104f9bbcd0776382ffab10]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260503 07:57:18.483309 27943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904abdfb5f89462c8a674a30012ffef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.452242 27942 rpcz_store.cc:276] 0503 07:57:17.332606 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:17.859417 (+526811us) service_pool.cc:224] Handling call
0503 07:57:18.039293 (+179876us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0503 07:57:18.069273 (+ 29980us) ts_tablet_manager.cc:682] Creating new metadata...
0503 07:57:18.425624 (+356351us) tablet_metadata.cc:665] Metadata flushed
0503 07:57:18.439694 (+ 14070us) tablet_replica.cc:206] Creating consensus instance
0503 07:57:18.440104 (+ 410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:57:18.509591 28151 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.451817 28149 raft_consensus.cc:385] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.511662 28149 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.512346 28149 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.514895 28035 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:18.516116 28149 ts_tablet_manager.cc:1434] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.105s user 0.005s sys 0.000s
I20260503 07:57:18.518035 28149 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.522503 28151 ts_tablet_manager.cc:1434] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260503 07:57:18.523437 28151 tablet_bootstrap.cc:492] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.528723 27949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cbd9f468974e1db163ad369f5d7d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.529836 27941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a813d887a574b1f8a8be222ff2c07ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.530375 27945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3757a05a49e489386cdbf85d2f8e970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.530925 27944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.531853 27947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb650978e344c697c44de57e4393e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.532580 27946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a767f631d84b75af79d3964f3a548f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.533120 28157 raft_consensus.cc:697] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:18.533521 27950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9196b781b73d42de863558f5a560cce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.534019 28157 consensus_queue.cc:237] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
W20260503 07:57:18.537293 27999 leader_election.cc:343] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.538102 27926 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:18.539218 27948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e28b4630c47646428fe7dd12f35f482a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:18.547852 28177 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:18.556944 28177 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:18.555022 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:18.561190 28177 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.557090 28149 tablet_bootstrap.cc:654] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.561489 28152 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:18.553306 27856 catalog_manager.cc:5671] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:18.557343 28154 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.565659 28154 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:18.568568 27905 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:57:18.560590 28151 tablet_bootstrap.cc:654] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.581475 28177 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.587003 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:18.587695 28035 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.588178 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:18.588743 28107 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.596796 28107 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:18.597771 27924 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:18.601910 28183 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:18.602092 28177 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.608500 28035 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:18.611343 28151 tablet_bootstrap.cc:492] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.611771 28151 ts_tablet_manager.cc:1403] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.000s
I20260503 07:57:18.614089 28154 ts_tablet_manager.cc:1434] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.127s user 0.011s sys 0.001s
I20260503 07:57:18.614876 28151 raft_consensus.cc:359] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.615401 28152 raft_consensus.cc:697] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:18.616675 28154 tablet_bootstrap.cc:492] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:18.616921 28152 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.617651 28151 raft_consensus.cc:385] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.617969 28151 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.619011 28149 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.619473 28149 ts_tablet_manager.cc:1403] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.103s user 0.022s sys 0.037s
I20260503 07:57:18.620666 28183 raft_consensus.cc:697] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:18.620764 28151 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.622277 28149 raft_consensus.cc:359] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.623008 28149 raft_consensus.cc:385] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.623142 28151 ts_tablet_manager.cc:1434] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20260503 07:57:18.625931 28151 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.623577 28149 raft_consensus.cc:740] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.627218 28149 consensus_queue.cc:260] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.629725 28149 ts_tablet_manager.cc:1434] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.010s user 0.004s sys 0.002s
I20260503 07:57:18.630542 28149 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.631070 27855 catalog_manager.cc:5671] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:18.623126 28183 consensus_queue.cc:237] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.638165 28149 tablet_bootstrap.cc:654] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.647938 27857 catalog_manager.cc:5671] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:18.651427 28154 tablet_bootstrap.cc:654] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.654058 28151 tablet_bootstrap.cc:654] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.660146 28149 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.660562 28149 ts_tablet_manager.cc:1403] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.003s
I20260503 07:57:18.664300 28149 raft_consensus.cc:359] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.665100 28149 raft_consensus.cc:385] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.665426 28149 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.666306 28149 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.669508 28149 ts_tablet_manager.cc:1434] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260503 07:57:18.671657 28149 tablet_bootstrap.cc:492] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.672969 28154 tablet_bootstrap.cc:492] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:18.673498 28154 ts_tablet_manager.cc:1403] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.057s user 0.007s sys 0.007s
I20260503 07:57:18.679651 28149 tablet_bootstrap.cc:654] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.676766 28154 raft_consensus.cc:359] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.687112 28154 raft_consensus.cc:385] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.687444 28154 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.688136 28154 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.698426 28154 ts_tablet_manager.cc:1434] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20260503 07:57:18.702183 28154 tablet_bootstrap.cc:492] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:18.703681 28151 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.704319 28151 ts_tablet_manager.cc:1403] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.079s user 0.009s sys 0.041s
I20260503 07:57:18.708155 28151 raft_consensus.cc:359] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.709048 28154 tablet_bootstrap.cc:654] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.712019 28149 tablet_bootstrap.cc:492] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.709125 28151 raft_consensus.cc:385] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.713616 28149 ts_tablet_manager.cc:1403] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.015s
I20260503 07:57:18.713603 28151 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.714368 28151 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.716693 28151 ts_tablet_manager.cc:1434] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260503 07:57:18.716343 28149 raft_consensus.cc:359] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.717088 28149 raft_consensus.cc:385] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.717324 28149 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.718034 28151 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.717897 28149 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.719832 28149 ts_tablet_manager.cc:1434] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260503 07:57:18.721073 28149 tablet_bootstrap.cc:492] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.726295 28183 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:18.727103 28149 tablet_bootstrap.cc:654] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.726725 28183 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.728564 28183 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.730043 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:18.730721 28107 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:18.733199 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:18.735078 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:18.736244 27926 leader_election.cc:343] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.737323 28183 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:18.737726 28183 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:18.738113 28183 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.746124 28151 tablet_bootstrap.cc:654] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.752837 28183 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.756407 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:18.757917 27926 leader_election.cc:343] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.758162 28183 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.759912 28154 tablet_bootstrap.cc:492] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:18.759738 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:18.760538 28107 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.760551 28154 ts_tablet_manager.cc:1403] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.059s user 0.018s sys 0.031s
I20260503 07:57:18.762445 28149 tablet_bootstrap.cc:492] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.762841 28149 ts_tablet_manager.cc:1403] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.042s user 0.024s sys 0.016s
I20260503 07:57:18.764500 28154 raft_consensus.cc:359] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.765378 28154 raft_consensus.cc:385] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.765586 28149 raft_consensus.cc:359] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.765815 28154 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.766238 28149 raft_consensus.cc:385] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.766551 28149 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.767172 28149 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.767609 28107 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:18.766993 28154 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.768530 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:18.769845 28183 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:18.771184 28154 ts_tablet_manager.cc:1434] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.010s user 0.005s sys 0.002s
I20260503 07:57:18.772681 28154 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:18.776214 28149 ts_tablet_manager.cc:1434] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260503 07:57:18.779863 28149 tablet_bootstrap.cc:492] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.781193 28154 tablet_bootstrap.cc:654] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.784665 28149 tablet_bootstrap.cc:654] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.786665 28183 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:18.787487 28183 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.794149 28154 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:18.794689 28154 ts_tablet_manager.cc:1403] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.009s
I20260503 07:57:18.795830 28151 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.795979 28149 tablet_bootstrap.cc:492] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.796265 28151 ts_tablet_manager.cc:1403] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.078s user 0.025s sys 0.017s
I20260503 07:57:18.796381 28149 ts_tablet_manager.cc:1403] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.003s
I20260503 07:57:18.797400 28154 raft_consensus.cc:359] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.798116 28154 raft_consensus.cc:385] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.798381 28154 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.798962 28154 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.799220 28149 raft_consensus.cc:359] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.799847 28149 raft_consensus.cc:385] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.800105 28149 raft_consensus.cc:740] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.800590 28157 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:18.799223 28151 raft_consensus.cc:359] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.800695 28149 consensus_queue.cc:260] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.801110 28151 raft_consensus.cc:385] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.801057 28157 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.801558 28151 raft_consensus.cc:740] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.802943 28157 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:18.802381 28151 consensus_queue.cc:260] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.803557 27857 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:18.804872 28149 ts_tablet_manager.cc:1434] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260503 07:57:18.805616 28151 ts_tablet_manager.cc:1434] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260503 07:57:18.805651 28149 tablet_bootstrap.cc:492] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.806749 28151 tablet_bootstrap.cc:492] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.807505 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:18.808056 28035 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:18.809556 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:18.810119 27959 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:18.811229 28075 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:18.811970 28157 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:18.812439 28157 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:18.812747 28157 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.814018 28151 tablet_bootstrap.cc:654] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.814770 28149 tablet_bootstrap.cc:654] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.819833 28154 ts_tablet_manager.cc:1434] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.025s user 0.002s sys 0.004s
I20260503 07:57:18.820966 28154 tablet_bootstrap.cc:492] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:18.825314 28152 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:18.825773 28152 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.826536 28151 tablet_bootstrap.cc:492] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.827008 28151 ts_tablet_manager.cc:1403] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.003s
I20260503 07:57:18.827594 28152 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.827740 28154 tablet_bootstrap.cc:654] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.830385 28149 tablet_bootstrap.cc:492] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.831610 28151 raft_consensus.cc:359] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.832518 28151 raft_consensus.cc:385] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.832887 28151 raft_consensus.cc:740] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.830399 28157 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.833743 28151 consensus_queue.cc:260] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.834654 28157 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:18.832188 28149 ts_tablet_manager.cc:1403] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.010s
I20260503 07:57:18.836002 28151 ts_tablet_manager.cc:1434] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260503 07:57:18.837287 28149 raft_consensus.cc:359] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.838174 28151 tablet_bootstrap.cc:492] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.838333 28149 raft_consensus.cc:385] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.838589 28149 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.838982 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:18.839461 27960 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.839246 28149 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.841377 28149 ts_tablet_manager.cc:1434] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260503 07:57:18.842180 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:18.842670 28149 tablet_bootstrap.cc:492] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.843214 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:18.844455 27999 leader_election.cc:343] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.844614 28151 tablet_bootstrap.cc:654] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.845293 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:18.846570 27999 leader_election.cc:343] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.846992 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:18.848209 28152 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:18.849251 28149 tablet_bootstrap.cc:654] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.855449 28154 tablet_bootstrap.cc:492] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:18.842725 28035 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.855930 28154 ts_tablet_manager.cc:1403] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.005s
I20260503 07:57:18.857412 28149 tablet_bootstrap.cc:492] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.857651 28151 tablet_bootstrap.cc:492] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.857774 28149 ts_tablet_manager.cc:1403] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20260503 07:57:18.857998 28151 ts_tablet_manager.cc:1403] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.005s
I20260503 07:57:18.858075 28152 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:18.858521 28152 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.864100 28149 raft_consensus.cc:359] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.864107 28151 raft_consensus.cc:359] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.864801 28149 raft_consensus.cc:385] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.864830 28151 raft_consensus.cc:385] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.865279 28151 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.865556 28152 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.866187 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:18.866102 28151 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:18.867583 27999 leader_election.cc:343] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.868031 28151 ts_tablet_manager.cc:1434] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260503 07:57:18.865274 28149 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.869169 28151 tablet_bootstrap.cc:492] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.869800 28149 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.868721 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:18.874465 28149 ts_tablet_manager.cc:1434] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.016s user 0.007s sys 0.003s
I20260503 07:57:18.874819 28151 tablet_bootstrap.cc:654] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.875257 28149 tablet_bootstrap.cc:492] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
W20260503 07:57:18.875430 27999 leader_election.cc:343] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.875862 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:18.876817 28152 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:18.878549 27960 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:18.889178 28073 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:18.882643 28149 tablet_bootstrap.cc:654] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.886188 28152 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:18.890025 28157 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:18.890208 28152 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.890661 28157 raft_consensus.cc:697] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:18.892052 28152 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.886873 28035 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:18.891736 28157 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.899240 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:18.900895 28151 tablet_bootstrap.cc:492] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.901001 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:18.901430 28151 ts_tablet_manager.cc:1403] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.019s
I20260503 07:57:18.901557 28107 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:18.903293 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:18.881079 28154 raft_consensus.cc:359] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.904259 28154 raft_consensus.cc:385] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.903926 28151 raft_consensus.cc:359] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.904546 28154 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.904760 28151 raft_consensus.cc:385] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.905197 28151 raft_consensus.cc:740] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.905246 28152 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:18.905680 28152 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:57:18.905787 27999 leader_election.cc:343] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.906028 28152 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.906688 28154 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.910531 28183 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:18.910990 28183 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.913314 28152 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.914556 28183 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.915278 28151 consensus_queue.cc:260] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.916978 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:18.918349 28151 ts_tablet_manager.cc:1434] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.017s user 0.002s sys 0.003s
I20260503 07:57:18.915601 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:18.916173 28152 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:18.919552 28107 raft_consensus.cc:2393] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:18.919533 28151 tablet_bootstrap.cc:492] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.920292 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:18.922971 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:18.923504 28107 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.926479 28151 tablet_bootstrap.cc:654] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.930519 28107 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:18.931496 28151 tablet_bootstrap.cc:492] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.931524 27926 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:18.932011 28151 ts_tablet_manager.cc:1403] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260503 07:57:18.932653 28183 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:18.934403 28151 raft_consensus.cc:359] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.935030 28151 raft_consensus.cc:385] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.935299 28151 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.936030 28151 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.937701 28151 ts_tablet_manager.cc:1434] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260503 07:57:18.938526 28151 tablet_bootstrap.cc:492] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.940555 28183 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:57:18.942716 27999 leader_election.cc:343] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:18.943173 28151 tablet_bootstrap.cc:654] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.945235 28175 consensus_queue.cc:1048] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:18.944026 28154 ts_tablet_manager.cc:1434] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.088s user 0.004s sys 0.004s
I20260503 07:57:18.947366 28154 tablet_bootstrap.cc:492] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:18.954190 28154 tablet_bootstrap.cc:654] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.953603 27857 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:18.959242 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:18.959630 28149 tablet_bootstrap.cc:492] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:18.960008 28149 ts_tablet_manager.cc:1403] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.085s user 0.029s sys 0.042s
I20260503 07:57:18.960052 28152 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:18.960554 28152 raft_consensus.cc:697] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:18.961382 28152 consensus_queue.cc:237] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.962591 28149 raft_consensus.cc:359] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.963219 28149 raft_consensus.cc:385] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.963474 28149 raft_consensus.cc:740] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.963876 28154 tablet_bootstrap.cc:492] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:18.964350 28154 ts_tablet_manager.cc:1403] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.001s
I20260503 07:57:18.964159 28149 consensus_queue.cc:260] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:18.965035 28073 consensus_peers.cc:597] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:18.966116 28149 ts_tablet_manager.cc:1434] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260503 07:57:18.966995 28149 tablet_bootstrap.cc:492] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:18.967139 28154 raft_consensus.cc:359] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.967900 28154 raft_consensus.cc:385] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.968221 28154 raft_consensus.cc:740] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.969131 28151 tablet_bootstrap.cc:492] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:18.968884 28154 consensus_queue.cc:260] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.969527 28151 ts_tablet_manager.cc:1403] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.003s
I20260503 07:57:18.971822 28154 ts_tablet_manager.cc:1434] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:57:18.972730 28149 tablet_bootstrap.cc:654] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.975879 28154 tablet_bootstrap.cc:492] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:18.976734 28151 raft_consensus.cc:359] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.977408 28151 raft_consensus.cc:385] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:18.977662 28151 raft_consensus.cc:740] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:18.984800 28154 tablet_bootstrap.cc:654] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:18.980989 28151 consensus_queue.cc:260] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:18.991758 28151 ts_tablet_manager.cc:1434] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.022s user 0.006s sys 0.001s
I20260503 07:57:18.996112 28151 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:18.997957 28154 tablet_bootstrap.cc:492] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:18.998334 28154 ts_tablet_manager.cc:1403] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.003s
I20260503 07:57:19.000578 28154 raft_consensus.cc:359] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.001175 28154 raft_consensus.cc:385] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.001405 28154 raft_consensus.cc:740] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.001946 28154 consensus_queue.cc:260] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.003523 28154 ts_tablet_manager.cc:1434] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:19.004841 28151 tablet_bootstrap.cc:654] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.004953 28149 tablet_bootstrap.cc:492] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.005335 28149 ts_tablet_manager.cc:1403] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.039s user 0.022s sys 0.007s
I20260503 07:57:19.007593 28149 raft_consensus.cc:359] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.008311 28149 raft_consensus.cc:385] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.008628 28149 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.009552 28149 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.012072 28149 ts_tablet_manager.cc:1434] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260503 07:57:19.013481 28149 tablet_bootstrap.cc:492] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.019632 28154 tablet_bootstrap.cc:492] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.020488 28149 tablet_bootstrap.cc:654] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.028425 28154 tablet_bootstrap.cc:654] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.030586 28151 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.033317 28151 ts_tablet_manager.cc:1403] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.037s user 0.015s sys 0.011s
I20260503 07:57:19.032620 27857 catalog_manager.cc:5671] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:19.037882 28149 tablet_bootstrap.cc:492] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.041910 28149 ts_tablet_manager.cc:1403] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.011s
I20260503 07:57:19.042241 28151 raft_consensus.cc:359] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.043215 28151 raft_consensus.cc:385] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.043466 28151 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.043557 28152 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.044004 28152 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.043727 28154 tablet_bootstrap.cc:492] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.045720 28152 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.046104 28154 ts_tablet_manager.cc:1403] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.008s
I20260503 07:57:19.045710 28149 raft_consensus.cc:359] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.046839 28149 raft_consensus.cc:385] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.047188 28149 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.047890 28149 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.048710 28154 raft_consensus.cc:359] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:19.049326 28154 raft_consensus.cc:385] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.049561 28154 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.049862 28149 ts_tablet_manager.cc:1434] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260503 07:57:19.050105 28154 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:19.050616 28149 tablet_bootstrap.cc:492] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.051011 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.054188 27960 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:19.055714 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:19.056725 28152 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.057155 28152 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.057171 28213 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.057585 28152 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.057663 28213 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.059827 28213 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.061398 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.051844 28154 ts_tablet_manager.cc:1434] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260503 07:57:19.051880 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.062691 28107 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:19.063490 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.064378 28154 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
W20260503 07:57:19.065411 27999 leader_election.cc:343] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:19.065994 27999 leader_election.cc:343] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.066358 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.067682 28213 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:19.072796 28183 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.044013 28151 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.073259 28149 tablet_bootstrap.cc:654] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.073258 28183 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.073251 28154 tablet_bootstrap.cc:654] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.074738 28151 ts_tablet_manager.cc:1434] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260503 07:57:19.077435 28151 tablet_bootstrap.cc:492] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.077934 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.078474 28107 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:19.079051 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.079537 27924 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.076920 28183 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.079607 28035 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:19.081149 28184 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.081508 28184 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.081847 28184 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.082660 28152 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.089303 28151 tablet_bootstrap.cc:654] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.089927 28184 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.093695 28152 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.096241 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.096740 28107 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.097045 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.097492 28035 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.101788 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.102301 27960 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.103508 28107 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:19.108718 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.109655 28152 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.110905 28152 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:19.112353 28149 tablet_bootstrap.cc:492] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.112161 28152 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.112888 28149 ts_tablet_manager.cc:1403] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.013s
I20260503 07:57:19.113543 27960 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:19.109663 28035 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:19.116305 27926 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:19.117314 28183 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.118485 28184 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.118657 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.119194 28107 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.121346 28151 tablet_bootstrap.cc:492] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.121717 28151 ts_tablet_manager.cc:1403] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.044s user 0.019s sys 0.019s
I20260503 07:57:19.116079 28149 raft_consensus.cc:359] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.123523 28149 raft_consensus.cc:385] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.123772 28149 raft_consensus.cc:740] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.125242 28149 consensus_queue.cc:260] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.126781 28107 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:19.127573 28149 ts_tablet_manager.cc:1434] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.014s user 0.003s sys 0.003s
I20260503 07:57:19.129004 28151 raft_consensus.cc:359] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.129640 28149 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.129772 28151 raft_consensus.cc:385] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.130116 28151 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.130740 28151 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.131863 28154 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.132236 28154 ts_tablet_manager.cc:1403] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.015s
I20260503 07:57:19.132486 28151 ts_tablet_manager.cc:1434] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20260503 07:57:19.133306 28151 tablet_bootstrap.cc:492] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.134497 28154 raft_consensus.cc:359] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.135078 28154 raft_consensus.cc:385] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.135311 28154 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.134003 27855 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:19.139909 28151 tablet_bootstrap.cc:654] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.142297 28183 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:19.143292 28149 tablet_bootstrap.cc:654] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.143246 28183 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.145299 28154 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.148567 28154 ts_tablet_manager.cc:1434] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260503 07:57:19.149617 28154 tablet_bootstrap.cc:492] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.158499 28152 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.159811 28151 tablet_bootstrap.cc:492] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.160203 28151 ts_tablet_manager.cc:1403] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.027s user 0.013s sys 0.011s
I20260503 07:57:19.162906 28151 raft_consensus.cc:359] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.163350 28151 raft_consensus.cc:385] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.163546 28151 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.164029 28151 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.165722 28151 ts_tablet_manager.cc:1434] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260503 07:57:19.166426 28154 tablet_bootstrap.cc:654] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.166555 28151 tablet_bootstrap.cc:492] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.167439 28149 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.167796 28149 ts_tablet_manager.cc:1403] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.000s
I20260503 07:57:19.170866 28149 raft_consensus.cc:359] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.171509 28149 raft_consensus.cc:385] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.171833 28149 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.172784 28151 tablet_bootstrap.cc:654] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.172513 28149 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.175369 28149 ts_tablet_manager.cc:1434] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260503 07:57:19.176402 28149 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.183984 28154 tablet_bootstrap.cc:492] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.186475 28178 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.188778 28154 ts_tablet_manager.cc:1403] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.039s user 0.008s sys 0.007s
I20260503 07:57:19.191635 28154 raft_consensus.cc:359] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.192163 28154 raft_consensus.cc:385] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.192402 28154 raft_consensus.cc:740] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.192919 28154 consensus_queue.cc:260] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.194692 28154 ts_tablet_manager.cc:1434] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260503 07:57:19.195441 28154 tablet_bootstrap.cc:492] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.197279 28184 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:19.200753 28154 tablet_bootstrap.cc:654] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.204131 28178 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.204561 28178 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.206436 28178 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.208140 28149 tablet_bootstrap.cc:654] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.208475 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.209807 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.210673 28151 tablet_bootstrap.cc:492] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.213374 28108 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:19.213778 28151 ts_tablet_manager.cc:1403] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.047s user 0.014s sys 0.009s
I20260503 07:57:19.215181 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.216111 28152 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.216418 28152 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.216713 28152 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.217300 28184 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.219810 28151 raft_consensus.cc:359] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.220602 28151 raft_consensus.cc:385] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.220921 28151 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
W20260503 07:57:19.224733 27999 leader_election.cc:343] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.225508 28151 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.228246 28151 ts_tablet_manager.cc:1434] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260503 07:57:19.229346 28151 tablet_bootstrap.cc:492] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.232954 28154 tablet_bootstrap.cc:492] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.238947 28154 ts_tablet_manager.cc:1403] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.044s user 0.021s sys 0.015s
I20260503 07:57:19.242384 28152 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.244513 28154 raft_consensus.cc:359] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.245158 28154 raft_consensus.cc:385] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.245433 28154 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.246168 28154 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.264946 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.266238 28154 ts_tablet_manager.cc:1434] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260503 07:57:19.267103 28154 tablet_bootstrap.cc:492] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
W20260503 07:57:19.268476 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 51645.9us
W20260503 07:57:19.272317 27999 leader_election.cc:343] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.273789 28035 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.244719 28152 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.251762 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.275171 28108 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.276070 28154 tablet_bootstrap.cc:654] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.279608 28157 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.280018 28157 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.281854 28157 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.282936 28242 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:19.284957 28108 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:19.260607 28227 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.286128 27856 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:19.287443 28227 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:19.262413 28178 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.288766 28178 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.259373 28151 tablet_bootstrap.cc:654] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.290934 28178 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.292910 28227 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.293692 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:19.295269 28178 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.295687 28178 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:19.296653 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.296941 28178 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.302944 28154 tablet_bootstrap.cc:492] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.284649 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.285591 28149 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.286022 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.303443 28154 ts_tablet_manager.cc:1403] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.037s user 0.022s sys 0.003s
I20260503 07:57:19.305709 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.303835 28149 ts_tablet_manager.cc:1403] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.128s user 0.010s sys 0.029s
I20260503 07:57:19.304138 28035 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:19.310360 28149 raft_consensus.cc:359] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.311396 28149 raft_consensus.cc:385] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.311700 28149 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.312227 28149 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.303668 27959 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:19.314324 28073 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.314670 28149 ts_tablet_manager.cc:1434] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260503 07:57:19.315116 28157 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.315425 28157 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.315726 28157 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.316032 28149 tablet_bootstrap.cc:492] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.321485 28149 tablet_bootstrap.cc:654] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.321415 28154 raft_consensus.cc:359] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.322120 28154 raft_consensus.cc:385] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.322382 28154 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.322607 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.323076 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.323210 27960 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:19.323017 28154 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.323730 28108 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:19.323421 28157 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.325105 28154 ts_tablet_manager.cc:1434] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260503 07:57:19.325304 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.325932 28154 tablet_bootstrap.cc:492] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.326190 28152 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.326619 28152 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.327009 28152 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.327459 28157 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.329236 28175 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.331768 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.332300 27960 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.342013 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.342182 28154 tablet_bootstrap.cc:654] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.342582 28035 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.348686 28151 tablet_bootstrap.cc:492] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.348614 27856 catalog_manager.cc:5671] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:19.350181 28151 ts_tablet_manager.cc:1403] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.121s user 0.008s sys 0.024s
I20260503 07:57:19.354774 28152 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.361924 28227 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.362015 28152 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.362429 28227 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.362771 28035 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.365310 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.365931 28108 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.365975 28227 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.366762 28157 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.367332 28157 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.369764 28157 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.370975 28075 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.371502 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.371869 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.372036 28035 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:19.372381 28107 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:19.372301 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.372962 28075 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.373229 27959 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:19.373785 28175 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.376888 27960 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.379308 28108 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:19.373639 27924 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.380259 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.322635 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.382441 28242 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:19.380862 28227 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.380936 28152 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.373857 28157 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.405155 28152 raft_consensus.cc:697] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:19.406286 28152 consensus_queue.cc:237] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.402509 28157 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.409272 28157 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.413069 28178 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.413640 28178 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.415899 28178 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.400199 28227 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.422914 28175 raft_consensus.cc:697] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:19.424551 28250 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:57:19.382668 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 60111.8us
I20260503 07:57:19.425418 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.426070 28227 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.429507 28151 raft_consensus.cc:359] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.430337 28154 tablet_bootstrap.cc:492] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.433859 28154 ts_tablet_manager.cc:1403] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.108s user 0.011s sys 0.009s
I20260503 07:57:19.434986 28149 tablet_bootstrap.cc:492] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.435323 28149 ts_tablet_manager.cc:1403] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.119s user 0.015s sys 0.006s
I20260503 07:57:19.432267 28250 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.436901 28149 raft_consensus.cc:359] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.436887 28154 raft_consensus.cc:359] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.437896 28149 raft_consensus.cc:385] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.438022 28154 raft_consensus.cc:385] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.438215 28149 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.438452 28250 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.438431 28154 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.438838 28149 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.439389 28154 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.441069 28149 ts_tablet_manager.cc:1434] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260503 07:57:19.441964 28154 ts_tablet_manager.cc:1434] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260503 07:57:19.442235 28151 raft_consensus.cc:385] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.448978 28151 raft_consensus.cc:740] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.447613 28149 tablet_bootstrap.cc:492] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.449565 28151 consensus_queue.cc:260] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.450040 28241 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260503 07:57:19.442528 27999 leader_election.cc:343] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.450665 28157 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:19.451246 27999 consensus_peers.cc:597] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:19.452131 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.452615 28035 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:19.444988 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.453470 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.453769 27959 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.454450 28033 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:19.449537 28154 tablet_bootstrap.cc:492] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.457993 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.458510 28033 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.459475 28151 ts_tablet_manager.cc:1434] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.109s user 0.006s sys 0.000s
I20260503 07:57:19.460126 28151 tablet_bootstrap.cc:492] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.441957 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.455758 28157 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.468698 28241 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.478842 28075 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.479223 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.482056 28250 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.486397 28241 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.487327 28250 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.488291 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.489272 28241 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.489837 28250 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.490278 28250 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.490607 28250 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.490868 28157 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.490911 28250 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.491376 28157 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.488335 27960 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:19.493247 28254 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260503 07:57:19.492519 28073 leader_election.cc:343] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.500228 28157 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.500761 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:19.501729 27924 leader_election.cc:343] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.502951 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.503501 27960 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:19.504572 28073 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.504904 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.505316 28157 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.481889 28175 consensus_queue.cc:237] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.505348 27999 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.505885 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.506150 28157 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.506299 27856 catalog_manager.cc:5671] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:19.507057 28157 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.508018 28152 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.508376 28152 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.508693 28152 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.511953 28178 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.512377 28178 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.514065 28178 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.516462 28033 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.518527 28250 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.521193 28250 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.522068 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.505532 27959 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
W20260503 07:57:19.521271 28073 leader_election.cc:343] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.523120 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.531562 28034 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:19.524708 28227 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.522589 28033 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:19.533649 27957 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:19.535085 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.535593 28033 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.535710 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.537710 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.538381 28107 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:57:19.539006 28075 leader_election.cc:343] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.537153 28227 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.543044 28154 tablet_bootstrap.cc:654] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:19.544693 28073 leader_election.cc:343] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.547410 27959 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.548792 28152 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.550282 28033 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.550926 28152 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.551509 28075 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:19.551652 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.552224 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.551796 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.555002 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.555202 28075 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:19.555514 27958 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.555894 28254 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.556332 28254 raft_consensus.cc:697] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:19.556792 28250 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.555006 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.557224 28250 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.557698 28250 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.556229 28075 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:19.552660 27957 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:19.558647 28178 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260503 07:57:19.560279 27999 leader_election.cc:343] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:19.561003 27999 leader_election.cc:343] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.557240 28254 consensus_queue.cc:237] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.567334 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.567726 28149 tablet_bootstrap.cc:654] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.568044 28032 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:19.563390 28251 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.562569 28227 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.570207 28151 tablet_bootstrap.cc:654] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.572427 28157 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.575559 28250 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.577119 28157 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.577369 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.580157 27957 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.580368 27856 catalog_manager.cc:5671] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:19.588577 28157 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.589200 28157 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.581784 28251 raft_consensus.cc:697] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:19.595893 27926 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.596675 28251 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.599570 28154 tablet_bootstrap.cc:492] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.599917 28154 ts_tablet_manager.cc:1403] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.151s user 0.023s sys 0.014s
I20260503 07:57:19.599388 28241 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:57:19.601588 28250 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.603360 28227 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.603714 28227 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:19.603969 27905 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:57:19.612987 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.613336 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.599424 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.616319 28157 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:19.619220 28073 leader_election.cc:343] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.622890 28154 raft_consensus.cc:359] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.623555 28154 raft_consensus.cc:385] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.623853 28154 raft_consensus.cc:740] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.624838 28178 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.624765 28227 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.625249 28178 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.625581 28178 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.625934 27958 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:19.626520 28227 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.627748 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.624545 28154 consensus_queue.cc:260] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.631347 28154 ts_tablet_manager.cc:1434] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20260503 07:57:19.630797 27956 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
W20260503 07:57:19.631415 27924 leader_election.cc:343] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.632290 28073 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.634485 28154 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.635492 27957 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.636435 28073 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.638370 28250 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.639875 28250 raft_consensus.cc:697] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:19.638002 28157 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.649209 28241 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.644639 28157 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.650210 28157 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.637874 28227 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.633695 28178 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.660941 28250 consensus_queue.cc:237] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.662655 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.664296 28032 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:19.658429 28227 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.664755 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.667073 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.667090 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.667739 28034 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
W20260503 07:57:19.668334 27924 leader_election.cc:343] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.668571 27999 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.669086 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.669346 28152 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.669842 28152 raft_consensus.cc:697] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:19.670328 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.670574 28152 consensus_queue.cc:237] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.671196 28241 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260503 07:57:19.671741 28075 leader_election.cc:343] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.672222 28151 tablet_bootstrap.cc:492] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.672580 28151 ts_tablet_manager.cc:1403] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.213s user 0.012s sys 0.013s
I20260503 07:57:19.673372 28032 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.673894 28149 tablet_bootstrap.cc:492] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.674346 28149 ts_tablet_manager.cc:1403] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.227s user 0.018s sys 0.011s
I20260503 07:57:19.669090 28157 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.683171 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.683821 27959 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.683646 28149 raft_consensus.cc:359] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.684475 28149 raft_consensus.cc:385] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.684811 28149 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.685523 28149 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.686825 28178 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.674894 28227 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.688131 28157 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:19.693089 28149 ts_tablet_manager.cc:1434] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.018s user 0.009s sys 0.000s
I20260503 07:57:19.693969 28149 tablet_bootstrap.cc:492] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.695492 28151 raft_consensus.cc:359] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.696728 28151 raft_consensus.cc:385] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.697074 28151 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.697098 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.698247 28034 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:19.700073 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:19.700014 28151 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.700970 27957 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 1: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:19.702226 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.702749 28151 ts_tablet_manager.cc:1434] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.030s user 0.006s sys 0.001s
I20260503 07:57:19.703553 28151 tablet_bootstrap.cc:492] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.704389 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.704866 28034 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.708557 27856 catalog_manager.cc:5671] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:19.711076 27856 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:19.720856 28154 tablet_bootstrap.cc:654] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.711596 27959 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.714488 27926 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.727233 28241 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:19.727564 28241 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:19.728793 28241 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.721547 28032 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.735450 28073 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:19.736878 27855 catalog_manager.cc:5671] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
W20260503 07:57:19.738286 27999 leader_election.cc:343] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:19.739220 28178 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.740926 28075 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:19.741070 28213 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.742019 28157 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.742461 28157 raft_consensus.cc:697] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:19.743554 28250 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.743219 28157 consensus_queue.cc:237] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.746204 28034 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:19.746338 28250 raft_consensus.cc:697] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:19.746780 27856 catalog_manager.cc:5671] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:19.752442 28241 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.759135 28241 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.759485 28250 consensus_queue.cc:237] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.760057 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:19.760607 28151 tablet_bootstrap.cc:654] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.760686 28109 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.761904 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.764739 28213 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:19.765305 28269 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:57:19.771384 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:19.771880 28034 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.788671 28154 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.789108 28154 ts_tablet_manager.cc:1403] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.157s user 0.010s sys 0.018s
I20260503 07:57:19.791841 28034 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:19.796458 28154 raft_consensus.cc:359] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.797755 28154 raft_consensus.cc:385] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.798041 28154 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.799110 28154 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.800235 28149 tablet_bootstrap.cc:654] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.801980 28154 ts_tablet_manager.cc:1434] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260503 07:57:19.780184 28241 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260503 07:57:19.803406 28154 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.805382 27926 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:19.806644 28242 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:19.807096 28242 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:19.808291 28242 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:19.823956 27999 consensus_peers.cc:597] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:19.823947 28109 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:19.853783 28269 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.851374 27856 catalog_manager.cc:5671] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:19.858664 27855 catalog_manager.cc:5671] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:19.867460 27855 catalog_manager.cc:5671] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:19.875662 28154 tablet_bootstrap.cc:654] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.876042 28151 tablet_bootstrap.cc:492] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.876421 28151 ts_tablet_manager.cc:1403] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.173s user 0.013s sys 0.012s
I20260503 07:57:19.882934 28149 tablet_bootstrap.cc:492] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.883329 28149 ts_tablet_manager.cc:1403] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.190s user 0.014s sys 0.027s
I20260503 07:57:19.883538 28151 raft_consensus.cc:359] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.884234 28151 raft_consensus.cc:385] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.884572 28151 raft_consensus.cc:740] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.896593 28269 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:19.899999 28151 consensus_queue.cc:260] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.902760 28151 ts_tablet_manager.cc:1434] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20260503 07:57:19.903932 28151 tablet_bootstrap.cc:492] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.909739 28149 raft_consensus.cc:359] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.910362 28149 raft_consensus.cc:385] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.910681 28154 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.910614 28149 raft_consensus.cc:740] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.911319 28149 consensus_queue.cc:260] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.912881 28149 ts_tablet_manager.cc:1434] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.029s user 0.006s sys 0.001s
I20260503 07:57:19.914148 28149 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.916328 28151 tablet_bootstrap.cc:654] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.916388 28154 ts_tablet_manager.cc:1403] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.113s user 0.019s sys 0.018s
I20260503 07:57:19.920102 28154 raft_consensus.cc:359] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.920658 28154 raft_consensus.cc:385] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.920943 28154 raft_consensus.cc:740] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.921535 28154 consensus_queue.cc:260] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.920965 28149 tablet_bootstrap.cc:654] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.924597 28154 ts_tablet_manager.cc:1434] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.008s user 0.002s sys 0.003s
I20260503 07:57:19.925695 28154 tablet_bootstrap.cc:492] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.928702 28269 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.929154 28269 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.933210 28242 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:19.933769 28269 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.933629 28242 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.935680 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:19.935972 28242 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:19.935927 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.937137 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:19.940493 27959 raft_consensus.cc:2393] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:19.942373 28154 tablet_bootstrap.cc:654] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.945429 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.946408 28269 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:19.950738 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:19.953872 27926 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:19.955008 28242 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:19.956081 28269 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:19.963773 28151 tablet_bootstrap.cc:492] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:19.964208 28151 ts_tablet_manager.cc:1403] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.007s
I20260503 07:57:19.966429 28149 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.966872 28149 ts_tablet_manager.cc:1403] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.053s user 0.015s sys 0.003s
I20260503 07:57:19.967010 28151 raft_consensus.cc:359] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.967811 28151 raft_consensus.cc:385] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.970613 28151 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.971294 28151 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.972738 28151 ts_tablet_manager.cc:1434] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260503 07:57:19.972267 28149 raft_consensus.cc:359] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.973107 28149 raft_consensus.cc:385] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.973476 28151 tablet_bootstrap.cc:492] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:19.973439 28149 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.974675 28149 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.977771 28154 tablet_bootstrap.cc:492] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:19.978166 28154 ts_tablet_manager.cc:1403] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.007s
I20260503 07:57:19.978353 28149 ts_tablet_manager.cc:1434] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260503 07:57:19.979557 28149 tablet_bootstrap.cc:492] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:19.983830 28151 tablet_bootstrap.cc:654] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.984455 28149 tablet_bootstrap.cc:654] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:19.990768 28149 tablet_bootstrap.cc:492] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:19.991309 28149 ts_tablet_manager.cc:1403] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20260503 07:57:19.991186 28154 raft_consensus.cc:359] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.991834 28154 raft_consensus.cc:385] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.992096 28154 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.992314 28251 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:19.992667 28154 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.994737 28149 raft_consensus.cc:359] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.995410 28149 raft_consensus.cc:385] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:19.995481 28154 ts_tablet_manager.cc:1434] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.017s user 0.002s sys 0.003s
I20260503 07:57:19.995754 28149 raft_consensus.cc:740] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:19.996389 28149 consensus_queue.cc:260] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:19.998294 28154 tablet_bootstrap.cc:492] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:19.998783 28149 ts_tablet_manager.cc:1434] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:57:20.002255 28149 tablet_bootstrap.cc:492] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.003619 28154 tablet_bootstrap.cc:654] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.008569 28242 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.008996 28242 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.011173 28242 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.015347 28149 tablet_bootstrap.cc:654] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.017311 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.018298 28034 raft_consensus.cc:2393] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:20.019302 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.015928 28151 tablet_bootstrap.cc:492] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.020162 28151 ts_tablet_manager.cc:1403] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.002s
I20260503 07:57:20.023150 28151 raft_consensus.cc:359] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.023927 28151 raft_consensus.cc:385] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.024276 28151 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.025084 28151 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.025924 27924 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.027460 28151 ts_tablet_manager.cc:1434] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:57:20.027305 28157 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.030055 28151 tablet_bootstrap.cc:492] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.027359 28242 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.037420 28151 tablet_bootstrap.cc:654] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.038178 28242 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.041003 28213 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.041409 28213 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.043087 28213 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.045837 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.046729 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.047181 28109 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:20.052361 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:20.053155 27999 leader_election.cc:343] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.053486 28213 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.053781 28213 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.054056 28213 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.065459 28157 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.068287 28154 tablet_bootstrap.cc:492] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.068800 28154 ts_tablet_manager.cc:1403] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.073s user 0.004s sys 0.028s
I20260503 07:57:20.084856 28157 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.085306 28213 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.087546 28213 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.089896 28151 tablet_bootstrap.cc:492] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.090101 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:20.090293 28151 ts_tablet_manager.cc:1403] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.060s user 0.009s sys 0.006s
I20260503 07:57:20.090566 28109 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.092707 28151 raft_consensus.cc:359] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.093343 28151 raft_consensus.cc:385] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.093605 28151 raft_consensus.cc:740] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.094206 28151 consensus_queue.cc:260] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.096307 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.099228 28109 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:20.099454 28151 ts_tablet_manager.cc:1434] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20260503 07:57:20.100505 28151 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.104617 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.102058 28154 raft_consensus.cc:359] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.106549 28154 raft_consensus.cc:385] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.106837 28154 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.108415 28109 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.109141 28269 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:57:20.109284 27999 leader_election.cc:343] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.109604 28269 raft_consensus.cc:697] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:20.107409 28154 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.110658 28152 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:20.112569 28269 consensus_queue.cc:237] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.117244 28157 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:20.128639 28154 ts_tablet_manager.cc:1434] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.059s user 0.002s sys 0.004s
I20260503 07:57:20.129462 28154 tablet_bootstrap.cc:492] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.134708 28154 tablet_bootstrap.cc:654] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.137112 28152 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.145638 28154 tablet_bootstrap.cc:492] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.146073 28154 ts_tablet_manager.cc:1403] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20260503 07:57:20.148490 28154 raft_consensus.cc:359] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.149125 28154 raft_consensus.cc:385] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.149372 28154 raft_consensus.cc:740] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.149912 28154 consensus_queue.cc:260] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.157312 28154 ts_tablet_manager.cc:1434] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260503 07:57:20.157744 28175 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.158049 28154 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.158128 28175 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.162323 28175 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.165998 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.166646 28033 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.167593 28075 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.169560 28175 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.169977 28175 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.170310 28175 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.170473 28149 tablet_bootstrap.cc:492] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.170979 28149 ts_tablet_manager.cc:1403] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.169s user 0.035s sys 0.048s
I20260503 07:57:20.173249 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:20.175338 28073 leader_election.cc:343] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.178751 28149 raft_consensus.cc:359] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.179864 28149 raft_consensus.cc:385] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.180269 28149 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.180807 28149 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.182230 28149 ts_tablet_manager.cc:1434] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260503 07:57:20.182623 28154 tablet_bootstrap.cc:654] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.182054 27857 catalog_manager.cc:5671] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:20.183037 28149 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.180655 28254 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:20.188694 27956 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.204267 28175 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.211278 28175 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.225811 28151 tablet_bootstrap.cc:654] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.225378 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.230942 28300 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.231443 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:20.235252 28034 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.235920 28300 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.236140 28184 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260503 07:57:20.236472 28073 leader_election.cc:343] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.240764 28254 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.240979 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.241501 28109 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:20.234997 28241 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.243263 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.243146 28241 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.237753 28300 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.245364 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.249432 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.249748 28149 tablet_bootstrap.cc:654] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.250514 28300 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.251667 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.252298 28241 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:20.261087 27999 leader_election.cc:343] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:20.269863 27924 leader_election.cc:343] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.257989 28154 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
W20260503 07:57:20.272900 27926 leader_election.cc:343] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.257167 28175 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260503 07:57:20.273350 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.274703 28241 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.275622 28151 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.276042 28151 ts_tablet_manager.cc:1403] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.176s user 0.005s sys 0.007s
I20260503 07:57:20.278587 28151 raft_consensus.cc:359] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.279176 28151 raft_consensus.cc:385] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.279934 28151 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.268801 28034 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:20.273310 28154 ts_tablet_manager.cc:1403] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.115s user 0.021s sys 0.012s
I20260503 07:57:20.273468 28149 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.280611 28151 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.281169 28149 ts_tablet_manager.cc:1403] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.098s user 0.012s sys 0.001s
I20260503 07:57:20.282657 28151 ts_tablet_manager.cc:1434] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260503 07:57:20.283726 28151 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.283915 28149 raft_consensus.cc:359] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.284480 28149 raft_consensus.cc:385] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.284698 28149 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.285279 28149 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.300629 28154 raft_consensus.cc:359] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.301514 28075 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:20.305115 28251 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:20.305559 28251 raft_consensus.cc:697] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:20.306285 28251 consensus_queue.cc:237] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.306857 28151 tablet_bootstrap.cc:654] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.291783 28254 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260503 07:57:20.255617 28300 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.313342 28300 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.316884 28154 raft_consensus.cc:385] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.322922 28154 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.323475 28184 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.323702 28251 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.323493 27855 catalog_manager.cc:5671] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:20.324820 28254 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.304271 28149 ts_tablet_manager.cc:1434] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.023s user 0.006s sys 0.002s
I20260503 07:57:20.330503 28149 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.330961 28154 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.342748 28154 ts_tablet_manager.cc:1434] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.057s user 0.006s sys 0.000s
I20260503 07:57:20.354246 28152 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.360525 28151 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.362033 28151 ts_tablet_manager.cc:1403] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.078s user 0.010s sys 0.009s
I20260503 07:57:20.361810 28152 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.363758 28152 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.365082 28154 tablet_bootstrap.cc:492] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.372871 28175 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.377701 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.382833 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.383490 27959 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:20.383780 28149 tablet_bootstrap.cc:654] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:20.385257 27999 leader_election.cc:343] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.386389 28151 raft_consensus.cc:359] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.387243 28151 raft_consensus.cc:385] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.381978 28300 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.387852 28184 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.389068 28184 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.390496 28300 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.391182 28184 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.387562 28151 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.392539 28154 tablet_bootstrap.cc:654] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.392726 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.393424 28107 raft_consensus.cc:2393] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:20.393180 28151 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.408087 28151 ts_tablet_manager.cc:1434] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.046s user 0.007s sys 0.000s
I20260503 07:57:20.408849 28151 tablet_bootstrap.cc:492] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.386724 27999 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.427268 28300 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.427695 28300 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.428082 28300 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.428396 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.430763 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:20.431699 28107 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.437774 28107 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:20.441583 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.442230 28152 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:57:20.442369 27999 leader_election.cc:343] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.442557 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.442726 28152 raft_consensus.cc:697] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:20.443567 28152 consensus_queue.cc:237] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.445508 28151 tablet_bootstrap.cc:654] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.452040 28149 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.453846 28149 ts_tablet_manager.cc:1403] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.123s user 0.018s sys 0.013s
I20260503 07:57:20.454226 28300 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.457733 28154 tablet_bootstrap.cc:492] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.458256 28154 ts_tablet_manager.cc:1403] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.093s user 0.010s sys 0.016s
I20260503 07:57:20.459450 27926 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.460444 28184 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.460640 28154 raft_consensus.cc:359] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.461282 28154 raft_consensus.cc:385] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.461541 28154 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.462293 28154 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.464895 28300 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.465780 28154 ts_tablet_manager.cc:1434] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260503 07:57:20.468004 28154 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.469192 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:20.469683 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.470182 27957 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:20.470813 27999 leader_election.cc:343] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.472697 27958 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.478192 27957 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:20.480191 28184 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.481312 27999 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.482466 28213 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:20.482625 28154 tablet_bootstrap.cc:654] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.483057 28213 raft_consensus.cc:697] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:20.484058 28213 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.491086 28154 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.491472 28154 ts_tablet_manager.cc:1403] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.000s
I20260503 07:57:20.459434 28149 raft_consensus.cc:359] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.498351 28154 raft_consensus.cc:359] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.498936 28154 raft_consensus.cc:385] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.499173 28154 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.499693 28154 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.496342 28149 raft_consensus.cc:385] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.503358 28149 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.503898 28154 ts_tablet_manager.cc:1434] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260503 07:57:20.504225 28149 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.504750 28154 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.506917 28149 ts_tablet_manager.cc:1434] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.052s user 0.003s sys 0.003s
I20260503 07:57:20.507897 28149 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.510298 28154 tablet_bootstrap.cc:654] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.520594 27854 catalog_manager.cc:5671] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:20.523212 28154 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.523556 28154 ts_tablet_manager.cc:1403] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.003s
I20260503 07:57:20.525333 28154 raft_consensus.cc:359] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.525970 28154 raft_consensus.cc:385] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.526217 28154 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.526798 28154 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.528527 28154 ts_tablet_manager.cc:1434] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:20.530397 28154 tablet_bootstrap.cc:492] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.532377 28149 tablet_bootstrap.cc:654] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.532814 28151 tablet_bootstrap.cc:492] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.533221 28151 ts_tablet_manager.cc:1403] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.125s user 0.050s sys 0.035s
I20260503 07:57:20.535650 28154 tablet_bootstrap.cc:654] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.536196 28152 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:20.537973 28151 raft_consensus.cc:359] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.542604 28151 raft_consensus.cc:385] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.542903 28151 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.543583 28151 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.544382 28149 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.544883 28149 ts_tablet_manager.cc:1403] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.037s user 0.013s sys 0.004s
I20260503 07:57:20.546168 28151 ts_tablet_manager.cc:1434] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260503 07:57:20.547765 28149 raft_consensus.cc:359] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.550562 28151 tablet_bootstrap.cc:492] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.550570 28149 raft_consensus.cc:385] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.551455 28149 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.552554 28149 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.555763 28151 tablet_bootstrap.cc:654] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.555655 27855 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:20.557456 28149 ts_tablet_manager.cc:1434] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.012s user 0.005s sys 0.002s
I20260503 07:57:20.558588 28149 tablet_bootstrap.cc:492] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.558367 28213 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.566228 28149 tablet_bootstrap.cc:654] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.570525 28154 tablet_bootstrap.cc:492] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.571038 28154 ts_tablet_manager.cc:1403] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.012s
I20260503 07:57:20.574723 28154 raft_consensus.cc:359] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.575754 28154 raft_consensus.cc:385] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.576144 28154 raft_consensus.cc:740] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.577064 28154 consensus_queue.cc:260] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.579456 28154 ts_tablet_manager.cc:1434] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260503 07:57:20.581024 28154 tablet_bootstrap.cc:492] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.587198 28154 tablet_bootstrap.cc:654] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.588415 28254 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.593190 28254 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.594513 28213 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.594946 28254 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.592657 28149 tablet_bootstrap.cc:492] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.596251 28149 ts_tablet_manager.cc:1403] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.008s
I20260503 07:57:20.594951 28213 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.597486 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.598129 27957 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:20.598451 28213 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.599154 28149 raft_consensus.cc:359] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.600140 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.600901 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.596326 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.605032 28032 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:20.605482 28151 tablet_bootstrap.cc:492] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.605903 28151 ts_tablet_manager.cc:1403] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.055s user 0.022s sys 0.023s
I20260503 07:57:20.608310 28151 raft_consensus.cc:359] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.608937 28151 raft_consensus.cc:385] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.609234 28151 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
W20260503 07:57:20.609441 27999 leader_election.cc:343] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.609875 28151 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.610623 28075 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:57:20.611882 27999 leader_election.cc:343] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.612224 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.613050 28151 ts_tablet_manager.cc:1434] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260503 07:57:20.613456 28149 raft_consensus.cc:385] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.613700 28213 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.613822 28149 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.614696 28151 tablet_bootstrap.cc:492] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.614575 28149 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.617189 28149 ts_tablet_manager.cc:1434] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260503 07:57:20.617966 28149 tablet_bootstrap.cc:492] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.622768 28254 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.628275 28254 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.639461 28149 tablet_bootstrap.cc:654] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.639601 28151 tablet_bootstrap.cc:654] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:20.639320 27905 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:57:20.640138 28154 tablet_bootstrap.cc:492] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.640532 28154 ts_tablet_manager.cc:1403] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.060s user 0.009s sys 0.024s
I20260503 07:57:20.643117 28154 raft_consensus.cc:359] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.643733 28154 raft_consensus.cc:385] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.644037 28154 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.645292 28149 tablet_bootstrap.cc:492] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.645198 28154 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.645665 28149 ts_tablet_manager.cc:1403] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.005s
I20260503 07:57:20.645749 28151 tablet_bootstrap.cc:492] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.646234 28151 ts_tablet_manager.cc:1403] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.005s
I20260503 07:57:20.647956 28149 raft_consensus.cc:359] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.648509 28149 raft_consensus.cc:385] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.648747 28149 raft_consensus.cc:740] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.648581 28151 raft_consensus.cc:359] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.649224 28151 raft_consensus.cc:385] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.649475 28151 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.649312 28149 consensus_queue.cc:260] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.650074 28151 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.651157 28149 ts_tablet_manager.cc:1434] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:20.652048 28149 tablet_bootstrap.cc:492] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.654242 28154 ts_tablet_manager.cc:1434] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.013s user 0.001s sys 0.005s
I20260503 07:57:20.655092 28154 tablet_bootstrap.cc:492] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.655306 28151 ts_tablet_manager.cc:1434] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260503 07:57:20.656060 28151 tablet_bootstrap.cc:492] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.660599 28154 tablet_bootstrap.cc:654] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.661479 28151 tablet_bootstrap.cc:654] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.671190 28149 tablet_bootstrap.cc:654] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.676048 28242 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.676666 28242 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.680140 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.680279 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.681425 28149 tablet_bootstrap.cc:492] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
W20260503 07:57:20.681398 27924 leader_election.cc:343] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.681941 28149 ts_tablet_manager.cc:1403] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.007s
W20260503 07:57:20.682013 27926 leader_election.cc:343] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.682729 27926 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.683760 28184 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.681967 28242 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.684948 28149 raft_consensus.cc:359] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.685578 28149 raft_consensus.cc:385] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.685837 28149 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.686429 28149 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.690743 28250 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.691146 28250 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.692793 28250 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.694096 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.695379 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:20.696097 28075 leader_election.cc:343] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:20.696681 28073 leader_election.cc:343] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.697113 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:20.698042 28250 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.695361 28149 ts_tablet_manager.cc:1434] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260503 07:57:20.700801 28149 tablet_bootstrap.cc:492] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.701838 28154 tablet_bootstrap.cc:492] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.702219 28154 ts_tablet_manager.cc:1403] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.015s
I20260503 07:57:20.704514 28154 raft_consensus.cc:359] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.705108 28154 raft_consensus.cc:385] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.705356 28154 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.707165 28154 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.707655 28149 tablet_bootstrap.cc:654] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.708613 28151 tablet_bootstrap.cc:492] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.709003 28151 ts_tablet_manager.cc:1403] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.053s user 0.023s sys 0.027s
I20260503 07:57:20.709110 28154 ts_tablet_manager.cc:1434] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260503 07:57:20.709975 28154 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.711256 28151 raft_consensus.cc:359] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.711825 28151 raft_consensus.cc:385] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.712065 28151 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.712601 28151 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.714547 28151 ts_tablet_manager.cc:1434] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:20.715312 28151 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.715901 28154 tablet_bootstrap.cc:654] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.720781 28149 tablet_bootstrap.cc:492] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.720882 28151 tablet_bootstrap.cc:654] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.721274 28149 ts_tablet_manager.cc:1403] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.006s
I20260503 07:57:20.727423 28149 raft_consensus.cc:359] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.728224 28149 raft_consensus.cc:385] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.728516 28149 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.729197 28149 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.734536 28154 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.734921 28154 ts_tablet_manager.cc:1403] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.003s
I20260503 07:57:20.736636 28149 ts_tablet_manager.cc:1434] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260503 07:57:20.737283 28154 raft_consensus.cc:359] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.737849 28154 raft_consensus.cc:385] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.738123 28154 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.738556 28151 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.738988 28151 ts_tablet_manager.cc:1403] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.009s
I20260503 07:57:20.738648 28154 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.740600 28154 ts_tablet_manager.cc:1434] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:20.741361 28151 raft_consensus.cc:359] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.742025 28151 raft_consensus.cc:385] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.742295 28151 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.742841 28151 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.744071 28154 tablet_bootstrap.cc:492] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.744608 28151 ts_tablet_manager.cc:1434] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260503 07:57:20.744733 28149 tablet_bootstrap.cc:492] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.745476 28151 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.751087 28149 tablet_bootstrap.cc:654] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.753280 28151 tablet_bootstrap.cc:654] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.754865 28154 tablet_bootstrap.cc:654] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.762115 28149 tablet_bootstrap.cc:492] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.762499 28149 ts_tablet_manager.cc:1403] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.006s
W20260503 07:57:20.763937 28073 consensus_peers.cc:597] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:20.764895 28151 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.765430 28151 ts_tablet_manager.cc:1403] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.004s
I20260503 07:57:20.767874 28151 raft_consensus.cc:359] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.768332 28151 raft_consensus.cc:385] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.768525 28151 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.769362 28151 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.770228 28254 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.770634 28254 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.770985 28149 raft_consensus.cc:359] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.771589 28149 raft_consensus.cc:385] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.771822 28149 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.772102 28254 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.772421 28149 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.772792 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.773660 27958 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.774513 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.775074 28033 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.776321 28151 ts_tablet_manager.cc:1434] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.011s user 0.004s sys 0.001s
I20260503 07:57:20.776978 28151 tablet_bootstrap.cc:492] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.779474 28149 ts_tablet_manager.cc:1434] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260503 07:57:20.780328 28149 tablet_bootstrap.cc:492] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.780161 28075 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.781183 28254 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.781486 28254 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.781767 28254 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.782655 28151 tablet_bootstrap.cc:654] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.788990 28254 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.789433 28149 tablet_bootstrap.cc:654] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.789795 28154 tablet_bootstrap.cc:492] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.790199 28154 ts_tablet_manager.cc:1403] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.046s user 0.013s sys 0.000s
I20260503 07:57:20.790993 28151 tablet_bootstrap.cc:492] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.791359 28151 ts_tablet_manager.cc:1403] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.004s
I20260503 07:57:20.791419 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.792001 27958 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.793366 28154 raft_consensus.cc:359] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.793957 28154 raft_consensus.cc:385] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.794220 28154 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.794103 28151 raft_consensus.cc:359] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.794688 28151 raft_consensus.cc:385] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.794951 28151 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.795066 28154 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.795533 28151 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.797327 28154 ts_tablet_manager.cc:1434] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260503 07:57:20.797377 28151 ts_tablet_manager.cc:1434] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260503 07:57:20.798321 28151 tablet_bootstrap.cc:492] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.807080 28151 tablet_bootstrap.cc:654] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.809994 28154 tablet_bootstrap.cc:492] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:20.810945 28254 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.811784 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:20.812312 28032 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.818456 28154 tablet_bootstrap.cc:654] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.819941 28032 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:20.820927 28075 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.821478 28242 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.821732 28250 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.822139 28250 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.820997 27958 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:20.824399 28250 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.822028 28242 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.825416 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.826175 27957 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.826759 28242 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.827965 28073 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.828619 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.829370 28175 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.829818 28033 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:20.830233 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.829845 28175 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.831455 28175 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.831384 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:20.833600 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.834307 28033 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.836067 28242 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.836596 28242 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.837085 28242 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.824966 28250 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:20.839040 28241 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.839375 28250 raft_consensus.cc:697] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:20.839618 28241 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.844936 28250 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.845893 28241 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.848588 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:20.850484 27924 leader_election.cc:343] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.842471 28175 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.852644 28109 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:20.852581 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.853549 28032 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:20.854821 27926 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.856252 28241 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.856591 28241 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.856909 28241 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.863128 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.864153 28175 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.871237 28149 tablet_bootstrap.cc:492] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.871053 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:20.871723 28149 ts_tablet_manager.cc:1403] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.092s user 0.036s sys 0.037s
I20260503 07:57:20.870795 28241 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.871882 28032 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.877560 28241 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.877519 28213 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.879467 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:20.880213 28149 raft_consensus.cc:359] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:20.880600 27924 leader_election.cc:343] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.880858 28149 raft_consensus.cc:385] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.881562 28149 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.882898 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:20.882779 28149 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.883419 28033 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.884701 28149 ts_tablet_manager.cc:1434] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260503 07:57:20.885741 28254 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:20.891558 28251 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.891985 28251 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.893842 28251 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.896273 28149 tablet_bootstrap.cc:492] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.896927 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.897671 28031 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.897891 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.900430 28075 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.901499 28251 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.901949 28251 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:57:20.902169 28073 leader_election.cc:343] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.902405 28251 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.902777 28149 tablet_bootstrap.cc:654] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.910203 28157 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.910718 28157 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.912915 28157 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.879645 28242 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.913663 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.914338 28213 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.914665 27956 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.914815 28242 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.914741 28213 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.915709 27958 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:20.916800 28213 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.914753 28149 tablet_bootstrap.cc:492] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:20.917865 28149 ts_tablet_manager.cc:1403] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.004s
I20260503 07:57:20.918766 28151 tablet_bootstrap.cc:492] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:20.919180 28151 ts_tablet_manager.cc:1403] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.121s user 0.037s sys 0.060s
I20260503 07:57:20.920437 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.881378 28250 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.924342 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.921509 28073 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.921629 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:20.924887 28031 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:20.925213 28109 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:20.921538 28151 raft_consensus.cc:359] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.922746 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:20.924561 27856 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:20.925727 28175 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:20.926163 28175 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:20.926497 28175 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.927780 28151 raft_consensus.cc:385] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.928056 28151 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.928503 28033 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:20.928596 28151 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.930219 28241 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.930613 28241 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.931138 28151 ts_tablet_manager.cc:1434] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260503 07:57:20.931883 28151 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:20.932188 28175 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.933112 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.933720 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:20.934291 28241 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:20.934851 27999 consensus_peers.cc:597] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 -> Peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Couldn't send request to peer be26cebb7c90445ea9a74f66463457c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:57:20.935380 27999 leader_election.cc:343] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.921548 28149 raft_consensus.cc:359] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.936185 28149 raft_consensus.cc:385] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.936455 28149 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.937068 28149 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.924136 28250 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.938235 28151 tablet_bootstrap.cc:654] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.938822 28149 ts_tablet_manager.cc:1434] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.021s user 0.004s sys 0.000s
I20260503 07:57:20.939625 28149 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:20.939579 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:20.941200 28073 leader_election.cc:343] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:20.945490 27999 leader_election.cc:343] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.945827 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.945887 27926 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.946460 28250 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.947208 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.948661 28184 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.948062 28242 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:20.950083 28242 raft_consensus.cc:697] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:20.950886 28242 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.952147 28154 tablet_bootstrap.cc:492] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:20.952653 28154 ts_tablet_manager.cc:1403] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.143s user 0.010s sys 0.008s
I20260503 07:57:20.953428 28213 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.955336 28154 raft_consensus.cc:359] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.955906 28154 raft_consensus.cc:385] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:20.956177 28154 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:20.956606 28251 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.961453 28149 tablet_bootstrap.cc:654] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:20.961922 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.963208 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.966058 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:20.966593 27958 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.970695 27956 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.971364 28175 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.972182 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:20.973441 27926 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:20.975430 27959 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:20.975926 28075 leader_election.cc:343] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.976786 28075 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:20.977937 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:20.978845 28034 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:20.981160 28175 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:20.982831 28213 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.983210 28251 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:20.983786 28032 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:20.983379 28213 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.985345 28213 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.985790 28152 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:20.986799 28241 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:20.987296 28241 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.989302 28241 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:20.991415 28034 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:20.992566 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.993310 28109 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:20.993996 28075 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:20.995000 28251 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:20.995409 28251 raft_consensus.cc:697] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:20.997294 28075 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:20.997864 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:20.998703 28250 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:57:20.998791 28073 leader_election.cc:343] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:20.999297 28250 raft_consensus.cc:697] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:57:20.999595 27924 leader_election.cc:343] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.000552 28250 consensus_queue.cc:237] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.993559 27958 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:21.004963 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.006194 28251 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:20.956702 28154 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.026449 28154 ts_tablet_manager.cc:1434] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.073s user 0.003s sys 0.003s
I20260503 07:57:21.027777 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.028476 27957 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:21.033459 28184 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:21.035678 27855 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.040551 28151 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.040961 28151 ts_tablet_manager.cc:1403] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.109s user 0.036s sys 0.056s
I20260503 07:57:21.041288 28213 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.041600 28250 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.042224 28300 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.042192 28250 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.042696 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.044183 28250 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.041647 28213 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.044927 28213 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.044886 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.045589 28151 raft_consensus.cc:359] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.046276 28151 raft_consensus.cc:385] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:57:21.046231 28073 leader_election.cc:343] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.043805 28034 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.046921 28151 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.047623 28151 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.048346 28154 tablet_bootstrap.cc:492] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:21.050134 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.051141 28032 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:21.055931 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.057963 27926 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:21.058830 28184 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.059136 28184 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.059412 28184 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.061632 28151 ts_tablet_manager.cc:1434] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260503 07:57:21.062379 28151 tablet_bootstrap.cc:492] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.063936 28213 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.064837 28149 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:21.065269 28149 ts_tablet_manager.cc:1403] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.126s user 0.009s sys 0.002s
I20260503 07:57:21.065546 28213 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.067380 28151 tablet_bootstrap.cc:654] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.067488 28149 raft_consensus.cc:359] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.068096 28149 raft_consensus.cc:385] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.068341 28149 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.070359 28184 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:21.073264 28075 leader_election.cc:343] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.073804 28075 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:21.075028 28250 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:21.068943 28149 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.080566 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.080674 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.082230 28154 tablet_bootstrap.cc:654] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.084206 28107 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.084319 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.084823 28035 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.084082 28149 ts_tablet_manager.cc:1434] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.019s user 0.004s sys 0.002s
I20260503 07:57:21.086355 28149 tablet_bootstrap.cc:492] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:21.081817 27959 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.082396 28184 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.084961 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.083562 28152 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.099649 27959 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.102077 28152 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.102406 28107 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.103582 28152 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.104945 28151 tablet_bootstrap.cc:492] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.105408 28151 ts_tablet_manager.cc:1403] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.003s
I20260503 07:57:21.105612 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.094313 28250 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:57:21.108246 27924 leader_election.cc:343] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.107741 28213 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.109724 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.110083 28213 raft_consensus.cc:697] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:21.111055 28034 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:21.110888 28213 consensus_queue.cc:237] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.115216 28035 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:21.115680 28151 raft_consensus.cc:359] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.116346 28151 raft_consensus.cc:385] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.116600 28151 raft_consensus.cc:740] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.117185 28151 consensus_queue.cc:260] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.117355 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.117875 27959 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:21.118496 28151 ts_tablet_manager.cc:1434] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260503 07:57:21.119094 28151 tablet_bootstrap.cc:492] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.120136 28075 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.120141 28250 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.121981 28251 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.121837 27926 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:21.122927 28251 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:21.123405 28184 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.123721 28109 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:21.123915 28251 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.124331 28184 raft_consensus.cc:697] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:21.125479 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:21.127843 28151 tablet_bootstrap.cc:654] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.127736 28152 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.128615 28152 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.129359 28152 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.126434 28184 consensus_queue.cc:237] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.134202 28250 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.134191 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.134382 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.134848 27959 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:21.136317 28073 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.136896 28250 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.137319 28250 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.137666 28250 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.140249 27855 catalog_manager.cc:5671] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.143754 28152 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.145547 28152 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.146550 28035 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:21.147053 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.148278 27956 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.149307 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.182713 28151 tablet_bootstrap.cc:492] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.182197 27855 catalog_manager.cc:5671] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.183087 28149 tablet_bootstrap.cc:654] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.183634 28151 ts_tablet_manager.cc:1403] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.009s
I20260503 07:57:21.188536 28151 raft_consensus.cc:359] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.176973 27956 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.189122 28151 raft_consensus.cc:385] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.189464 28151 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.190078 28151 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.191874 28151 ts_tablet_manager.cc:1434] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:21.193017 28151 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.193754 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:21.194403 28213 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.194828 28213 raft_consensus.cc:697] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:21.195654 28213 consensus_queue.cc:237] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.188797 28250 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.197597 28109 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:21.198726 28151 tablet_bootstrap.cc:654] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.198925 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.199604 27956 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:21.201036 28250 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.202979 28154 tablet_bootstrap.cc:492] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:21.202055 27854 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:21.203358 28154 ts_tablet_manager.cc:1403] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.176s user 0.013s sys 0.000s
I20260503 07:57:21.206151 28154 raft_consensus.cc:359] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.206375 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.206784 28154 raft_consensus.cc:385] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.207043 28154 raft_consensus.cc:740] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.207553 28075 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:21.204654 27854 catalog_manager.cc:5671] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:21.210319 28251 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260503 07:57:21.210628 28149 tablet_bootstrap.cc:492] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:21.211035 28149 ts_tablet_manager.cc:1403] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.125s user 0.004s sys 0.006s
I20260503 07:57:21.207618 28154 consensus_queue.cc:260] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.213233 28154 ts_tablet_manager.cc:1434] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260503 07:57:21.214234 28154 tablet_bootstrap.cc:492] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:21.214190 28149 raft_consensus.cc:359] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.215348 28149 raft_consensus.cc:385] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.216176 28149 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.216763 28149 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.217752 28151 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.218127 28151 ts_tablet_manager.cc:1403] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.007s
I20260503 07:57:21.219465 28154 tablet_bootstrap.cc:654] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.220607 28151 raft_consensus.cc:359] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.221271 28151 raft_consensus.cc:385] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.221501 28151 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.223480 28149 ts_tablet_manager.cc:1434] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260503 07:57:21.224294 28149 tablet_bootstrap.cc:492] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:21.229130 28149 tablet_bootstrap.cc:654] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.229277 28151 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.230856 28154 tablet_bootstrap.cc:492] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:21.231292 28154 ts_tablet_manager.cc:1403] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.004s
I20260503 07:57:21.231858 28151 ts_tablet_manager.cc:1434] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260503 07:57:21.232611 28151 tablet_bootstrap.cc:492] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.233599 28154 raft_consensus.cc:359] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.234200 28154 raft_consensus.cc:385] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.234463 28154 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.236768 28154 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.238525 28151 tablet_bootstrap.cc:654] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.238895 28154 ts_tablet_manager.cc:1434] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:57:21.239761 28154 tablet_bootstrap.cc:492] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:21.240075 28149 tablet_bootstrap.cc:492] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:21.240477 28149 ts_tablet_manager.cc:1403] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.008s
I20260503 07:57:21.242969 28149 raft_consensus.cc:359] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.243517 28149 raft_consensus.cc:385] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.243752 28149 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.240101 27856 catalog_manager.cc:5671] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:21.246810 28154 tablet_bootstrap.cc:654] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.247455 28358 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.247895 28358 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.249720 28358 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.250273 27956 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.252393 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.253969 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.255014 28109 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
W20260503 07:57:21.256870 27999 leader_election.cc:343] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.257655 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.259126 28358 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.259505 28358 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.259935 28358 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.259933 28149 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.261977 28149 ts_tablet_manager.cc:1434] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260503 07:57:21.262825 28149 tablet_bootstrap.cc:492] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:21.268270 28149 tablet_bootstrap.cc:654] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.272682 28151 tablet_bootstrap.cc:492] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.273160 28151 ts_tablet_manager.cc:1403] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.041s user 0.016s sys 0.002s
I20260503 07:57:21.273206 28358 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.275530 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.276194 28358 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.277145 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.277798 28109 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.281169 28154 tablet_bootstrap.cc:492] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:21.281626 28154 ts_tablet_manager.cc:1403] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.042s user 0.024s sys 0.008s
W20260503 07:57:21.281936 27999 leader_election.cc:343] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.283540 28353 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.284158 28154 raft_consensus.cc:359] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.284147 28353 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.285097 28154 raft_consensus.cc:385] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.285475 28154 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.286054 28154 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.287751 28109 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.288818 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.289168 28154 ts_tablet_manager.cc:1434] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260503 07:57:21.296679 28151 raft_consensus.cc:359] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.288684 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.303884 28151 raft_consensus.cc:385] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.304199 28151 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.304896 28154 tablet_bootstrap.cc:492] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
W20260503 07:57:21.304785 27924 leader_election.cc:343] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.304973 28213 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.306455 28213 raft_consensus.cc:697] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:21.308501 28107 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.307498 28213 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.289667 28353 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.313880 28154 tablet_bootstrap.cc:654] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.317876 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.318462 28035 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:21.321198 27926 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:21.321584 28300 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.322100 28300 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.315022 27855 catalog_manager.cc:5671] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.324579 28300 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.322417 28184 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.325143 28184 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.325479 28184 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.330174 28151 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.334446 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.336140 27957 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:21.333945 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.338080 28109 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:21.339370 27999 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.340202 28300 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.340662 28300 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.341074 28300 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.347899 28149 tablet_bootstrap.cc:492] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:21.348295 28149 ts_tablet_manager.cc:1403] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.086s user 0.028s sys 0.027s
I20260503 07:57:21.340060 28184 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.349442 28250 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.351037 28149 raft_consensus.cc:359] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.358282 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.358743 28149 raft_consensus.cc:385] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.358891 28035 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.359107 28149 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.358757 28250 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.359753 28149 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.361598 28149 ts_tablet_manager.cc:1434] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.013s user 0.002s sys 0.004s
I20260503 07:57:21.362505 28149 tablet_bootstrap.cc:492] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:21.363327 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:21.364513 28073 leader_election.cc:343] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.365180 28035 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:21.365900 28250 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.366003 27926 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:21.366828 28353 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.367287 28353 raft_consensus.cc:697] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:21.368101 28149 tablet_bootstrap.cc:654] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.368045 28353 consensus_queue.cc:237] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.372406 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.372956 28032 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:21.376184 28075 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.377140 28250 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.377480 28250 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.377787 28250 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.381242 28157 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.383003 28151 ts_tablet_manager.cc:1434] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.110s user 0.005s sys 0.006s
I20260503 07:57:21.383922 28151 tablet_bootstrap.cc:492] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.384018 28109 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.390147 28151 tablet_bootstrap.cc:654] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.353266 27854 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.356009 28300 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.356346 28184 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.357316 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.358326 28154 tablet_bootstrap.cc:492] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:21.394083 28154 ts_tablet_manager.cc:1403] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.089s user 0.013s sys 0.000s
I20260503 07:57:21.395031 28300 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.396359 28154 raft_consensus.cc:359] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.396973 28154 raft_consensus.cc:385] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.397692 28154 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.398262 28154 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.398538 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.399019 27957 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.400133 28154 ts_tablet_manager.cc:1434] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260503 07:57:21.400944 28154 tablet_bootstrap.cc:492] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
W20260503 07:57:21.401453 27924 leader_election.cc:343] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.406356 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.406900 28107 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.410678 28157 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.418455 28107 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.419772 27999 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.420433 28300 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.420969 28300 raft_consensus.cc:697] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:21.421506 27957 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.436221 28157 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.436630 28157 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.439039 28157 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.440140 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.441515 28154 tablet_bootstrap.cc:654] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.441041 28035 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:21.421708 28300 consensus_queue.cc:237] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.447423 28149 tablet_bootstrap.cc:492] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:21.447844 28149 ts_tablet_manager.cc:1403] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.086s user 0.015s sys 0.031s
I20260503 07:57:21.446501 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.457108 28213 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.457537 28213 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.457461 28251 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.458349 28251 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.459276 28213 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.459983 28251 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.462910 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.457305 28073 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:21.465042 28157 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:21.465830 27999 leader_election.cc:343] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.467087 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:21.468271 27999 leader_election.cc:343] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.468669 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:21.465197 28250 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.469400 28358 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:21.469990 28353 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.470645 28250 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.473923 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.474494 27957 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:21.474406 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.475126 28157 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:21.473891 28251 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260503 07:57:21.478615 28353 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.478559 27854 catalog_manager.cc:5671] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.480324 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.480868 28034 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.490597 28149 raft_consensus.cc:359] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.491385 28149 raft_consensus.cc:385] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.491711 28149 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.492528 28151 tablet_bootstrap.cc:492] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.493188 28073 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.494297 28034 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:21.492440 28149 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.494423 28151 ts_tablet_manager.cc:1403] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.111s user 0.026s sys 0.035s
I20260503 07:57:21.495720 28250 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260503 07:57:21.496084 28154 tablet_bootstrap.cc:492] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:21.509984 28154 ts_tablet_manager.cc:1403] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.109s user 0.009s sys 0.010s
I20260503 07:57:21.509653 28151 raft_consensus.cc:359] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.510489 28151 raft_consensus.cc:385] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.510808 28151 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.511873 28149 ts_tablet_manager.cc:1434] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.064s user 0.006s sys 0.002s
I20260503 07:57:21.511719 28151 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:21.499228 28073 leader_election.cc:343] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.499387 28251 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.516765 28151 ts_tablet_manager.cc:1434] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260503 07:57:21.516868 28251 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.517421 28251 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.517638 28151 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.499462 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.515111 28149 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:21.525902 28151 tablet_bootstrap.cc:654] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.532212 28075 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.532819 28157 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.533294 28157 raft_consensus.cc:697] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:57:21.533774 28075 leader_election.cc:343] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.534022 28157 consensus_queue.cc:237] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.536579 28269 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.538416 28151 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.539024 27854 catalog_manager.cc:5671] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.544090 28151 ts_tablet_manager.cc:1403] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.027s user 0.012s sys 0.005s
I20260503 07:57:21.546257 28269 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.546296 28151 raft_consensus.cc:359] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.547096 28151 raft_consensus.cc:385] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.546942 28269 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.550127 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.550102 28154 raft_consensus.cc:359] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.550758 28107 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:21.550139 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:21.552609 27999 leader_election.cc:343] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.550768 28154 raft_consensus.cc:385] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.553830 28149 tablet_bootstrap.cc:654] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.553659 28154 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.554232 28269 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.554507 28154 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.557540 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.559212 28154 ts_tablet_manager.cc:1434] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.049s user 0.005s sys 0.003s
I20260503 07:57:21.547390 28151 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.561049 28151 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.567114 28151 ts_tablet_manager.cc:1434] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260503 07:57:21.567854 28151 tablet_bootstrap.cc:492] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.561851 28213 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.569548 28213 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.569962 28213 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.571724 28358 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.589193 28154 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:21.632436 28251 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.653846 28352 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.655392 28352 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.656800 27854 catalog_manager.cc:5671] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:21.657848 28395 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:21.661280 28152 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.661700 28152 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.663307 28152 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.665814 28251 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.668164 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.668692 28107 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
W20260503 07:57:21.669732 27905 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:57:21.670519 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.655618 28213 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.678586 28213 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.679808 28151 tablet_bootstrap.cc:654] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.672688 28152 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:21.671973 28242 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260503 07:57:21.675016 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.680720 28152 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.686427 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.690896 27958 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.691468 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.692507 27959 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.695838 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.697340 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.697831 28109 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:21.698439 27999 leader_election.cc:343] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:21.699239 27999 consensus_peers.cc:597] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:21.688676 28152 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:21.700461 28075 leader_election.cc:343] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:21.721624 28152 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.723366 28152 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.702658 27958 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:21.725611 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.726151 27959 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:21.730475 28109 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:21.731354 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.733250 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:21.733767 28107 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:21.738570 28152 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:21.739161 28152 raft_consensus.cc:697] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:21.740146 28152 consensus_queue.cc:237] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.764413 28107 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:21.765511 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.767329 28300 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:21.767766 28300 raft_consensus.cc:697] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:21.768522 28300 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.771092 28358 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.780894 28149 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:21.781455 28149 ts_tablet_manager.cc:1403] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.267s user 0.031s sys 0.049s
I20260503 07:57:21.765496 27959 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
W20260503 07:57:21.790550 28391 log.cc:927] Time spent T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.127s user 0.000s sys 0.001s
W20260503 07:57:21.791841 28397 log.cc:927] Time spent T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.079s user 0.001s sys 0.000s
I20260503 07:57:21.801496 28073 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:21.802470 28157 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
W20260503 07:57:21.802625 28073 consensus_peers.cc:597] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:21.802904 28157 raft_consensus.cc:697] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:21.804823 28157 consensus_queue.cc:237] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.805584 28184 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.805982 28184 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.806429 28241 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.807796 28184 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:21.807680 27854 catalog_manager.cc:5671] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.810350 28358 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.813251 28251 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.813675 28251 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.815150 28251 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.817418 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:21.818593 28154 tablet_bootstrap.cc:654] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.819650 28149 raft_consensus.cc:359] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.820127 28149 raft_consensus.cc:385] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.820323 28149 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.819042 28184 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260503 07:57:21.820811 28149 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.822718 28149 ts_tablet_manager.cc:1434] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.041s user 0.004s sys 0.000s
I20260503 07:57:21.823370 28151 tablet_bootstrap.cc:492] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:21.823559 28149 tablet_bootstrap.cc:492] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:21.823887 28151 ts_tablet_manager.cc:1403] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.256s user 0.031s sys 0.022s
I20260503 07:57:21.837039 28395 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:21.838975 28395 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.843425 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.844368 28033 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:21.847469 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.848057 27958 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:21.849143 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.849700 28034 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:21.849855 28073 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:21.850658 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:21.851908 28250 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.852001 28395 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.852315 28250 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.852641 28250 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.863950 27854 catalog_manager.cc:5671] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:21.852873 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:21.872938 28151 raft_consensus.cc:359] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.875104 28151 raft_consensus.cc:385] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.875437 28151 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.876192 28151 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:21.870901 28073 leader_election.cc:343] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:21.871608 27924 consensus_peers.cc:597] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 -> Peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Couldn't send request to peer be26cebb7c90445ea9a74f66463457c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:21.879014 28151 ts_tablet_manager.cc:1434] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.055s user 0.005s sys 0.000s
I20260503 07:57:21.881206 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:21.882184 28353 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.877777 28034 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:21.883885 28151 tablet_bootstrap.cc:492] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:21.910246 28075 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:21.911566 28352 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:21.912003 28352 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:21.912402 28352 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.887027 27855 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 2, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:21.939483 28358 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:21.942870 28353 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:21.943795 28250 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.943888 28352 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.949368 28250 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.950992 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.951550 28033 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.952551 28154 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:21.952926 28154 ts_tablet_manager.cc:1403] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.364s user 0.011s sys 0.003s
I20260503 07:57:21.953917 28352 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:21.954134 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.954867 28154 raft_consensus.cc:359] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:21.954676 27960 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.955333 28154 raft_consensus.cc:385] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:21.955549 28154 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:21.955940 28154 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:21.957002 28406 log.cc:927] Time spent T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260503 07:57:21.959192 28149 tablet_bootstrap.cc:654] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.959241 28154 ts_tablet_manager.cc:1434] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260503 07:57:21.969485 28154 tablet_bootstrap.cc:492] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:21.965126 27960 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:21.966077 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:21.967089 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:21.974381 27958 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.973802 28032 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:21.981870 28151 tablet_bootstrap.cc:654] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:21.990473 28033 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:21.980696 28073 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:22.002736 28250 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.011950 28032 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:22.012624 28154 tablet_bootstrap.cc:654] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.011005 27958 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:22.014952 28151 tablet_bootstrap.cc:492] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.014883 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:22.015579 28151 ts_tablet_manager.cc:1403] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.132s user 0.022s sys 0.018s
I20260503 07:57:22.009532 28250 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:22.017791 28352 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.020886 28352 raft_consensus.cc:697] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:22.021649 28352 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.025231 28396 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.025645 28396 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.029006 28396 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.029878 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.031791 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.034379 28149 tablet_bootstrap.cc:492] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.034945 28149 ts_tablet_manager.cc:1403] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.212s user 0.009s sys 0.003s
W20260503 07:57:22.037216 28073 leader_election.cc:343] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.037977 28149 raft_consensus.cc:359] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.038460 28149 raft_consensus.cc:385] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.038702 28149 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.039306 28149 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.040553 28149 ts_tablet_manager.cc:1434] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260503 07:57:22.041352 28075 leader_election.cc:343] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.041607 28149 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.041805 28075 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:22.042546 28352 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:22.043846 28358 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.086885 28250 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.102135 28151 raft_consensus.cc:359] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.105726 28151 raft_consensus.cc:385] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.105975 28151 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.107128 28154 tablet_bootstrap.cc:492] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.107658 28154 ts_tablet_manager.cc:1403] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.138s user 0.014s sys 0.018s
I20260503 07:57:22.107175 28151 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.110589 28269 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.111027 28269 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.113231 28269 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.114033 28154 raft_consensus.cc:359] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.114624 28154 raft_consensus.cc:385] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.114877 28154 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.115363 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.115442 28154 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.117237 28154 ts_tablet_manager.cc:1434] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260503 07:57:22.120390 28154 tablet_bootstrap.cc:492] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.124425 28151 ts_tablet_manager.cc:1434] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.109s user 0.001s sys 0.005s
I20260503 07:57:22.125252 28151 tablet_bootstrap.cc:492] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.128798 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:22.144098 27999 leader_election.cc:343] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.144101 28300 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:22.148592 28251 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.149547 28149 tablet_bootstrap.cc:654] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:22.156605 27999 leader_election.cc:343] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.157258 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:22.158627 28300 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:22.160677 28154 tablet_bootstrap.cc:654] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.166980 27855 catalog_manager.cc:5671] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:22.167925 28151 tablet_bootstrap.cc:654] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.168923 27855 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:22.175774 28352 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.179498 28149 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.179874 28149 ts_tablet_manager.cc:1403] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.139s user 0.008s sys 0.005s
I20260503 07:57:22.184787 28300 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.185395 28149 raft_consensus.cc:359] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.185990 28149 raft_consensus.cc:385] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.186275 28149 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.186872 28149 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.188341 27959 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.188798 28149 ts_tablet_manager.cc:1434] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260503 07:57:22.190649 28151 tablet_bootstrap.cc:492] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.191658 28352 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.220113 28352 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.220678 28417 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.221194 28417 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.222167 28352 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.209195 28396 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.223001 28417 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.226300 27960 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260503 07:57:22.227144 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:22.228344 28073 leader_election.cc:343] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.229828 28151 ts_tablet_manager.cc:1403] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.105s user 0.008s sys 0.005s
I20260503 07:57:22.233296 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.232770 28151 raft_consensus.cc:359] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.236737 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:22.236964 28151 raft_consensus.cc:385] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.237268 28151 raft_consensus.cc:740] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.237890 28151 consensus_queue.cc:260] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:22.239603 27999 leader_election.cc:343] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.243638 28149 tablet_bootstrap.cc:492] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.245707 28417 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.247951 28417 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.242846 28151 ts_tablet_manager.cc:1434] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260503 07:57:22.249459 28151 tablet_bootstrap.cc:492] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.250196 28154 tablet_bootstrap.cc:492] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.250620 28154 ts_tablet_manager.cc:1403] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.132s user 0.024s sys 0.028s
W20260503 07:57:22.250715 27999 leader_election.cc:343] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.251111 27999 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:22.251724 28300 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:22.253145 28154 raft_consensus.cc:359] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.253533 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.269299 28154 raft_consensus.cc:385] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.257297 28149 tablet_bootstrap.cc:654] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.257853 28151 tablet_bootstrap.cc:654] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.269647 28154 raft_consensus.cc:740] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.269665 28032 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:22.271548 28154 consensus_queue.cc:260] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.293998 28154 ts_tablet_manager.cc:1434] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.043s user 0.005s sys 0.000s
I20260503 07:57:22.294857 28154 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.298511 28075 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
W20260503 07:57:22.303260 28075 consensus_peers.cc:597] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 -> Peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Couldn't send request to peer adaf84b6ac60420ab03d39b9db9f0413. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:22.303390 28157 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.303670 28157 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.303934 28157 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.339747 28109 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260503 07:57:22.352370 28395 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.356036 28157 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.357921 28157 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.352828 28395 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.362489 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:57:22.363547 28073 leader_election.cc:343] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.364552 28395 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.368096 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.368211 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.366544 28358 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260503 07:57:22.368850 27959 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
W20260503 07:57:22.369599 28075 leader_election.cc:343] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.370163 28073 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:22.370908 28395 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.371274 28395 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.371635 28395 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:22.371865 28427 log.cc:927] Time spent T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260503 07:57:22.374568 28149 tablet_bootstrap.cc:492] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.375025 28149 ts_tablet_manager.cc:1403] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.132s user 0.008s sys 0.009s
I20260503 07:57:22.376689 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:22.377921 28034 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.383998 28151 tablet_bootstrap.cc:492] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.384387 28151 ts_tablet_manager.cc:1403] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.135s user 0.006s sys 0.004s
I20260503 07:57:22.386664 28151 raft_consensus.cc:359] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.390311 28151 raft_consensus.cc:385] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.390512 28151 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.391039 28151 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.396838 28395 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.399537 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:22.400005 27956 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.409708 27956 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:22.410825 28073 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:22.411586 28352 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.412128 28352 raft_consensus.cc:697] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:22.412783 28352 consensus_queue.cc:237] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.413942 28149 raft_consensus.cc:359] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.415443 28149 raft_consensus.cc:385] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.415879 28149 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.415138 28151 ts_tablet_manager.cc:1434] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.031s user 0.003s sys 0.005s
I20260503 07:57:22.417348 28151 tablet_bootstrap.cc:492] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.417747 28149 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.422163 28149 ts_tablet_manager.cc:1434] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.047s user 0.004s sys 0.003s
I20260503 07:57:22.422762 28395 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.424532 28154 tablet_bootstrap.cc:654] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.425575 28149 tablet_bootstrap.cc:492] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.427825 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:22.430042 28075 leader_election.cc:343] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.431618 28034 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:22.432945 28075 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:22.437609 28395 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.438254 28395 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:22.439461 28395 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.444949 28149 tablet_bootstrap.cc:654] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.451270 27855 catalog_manager.cc:5671] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:22.452394 28154 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.453425 28154 ts_tablet_manager.cc:1403] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.159s user 0.018s sys 0.016s
I20260503 07:57:22.455593 28154 raft_consensus.cc:359] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.456193 28154 raft_consensus.cc:385] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.456472 28154 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.457099 28154 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.459008 28154 ts_tablet_manager.cc:1434] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:22.459782 28154 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.464444 28149 tablet_bootstrap.cc:492] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.464931 28149 ts_tablet_manager.cc:1403] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.039s user 0.016s sys 0.005s
I20260503 07:57:22.465868 28154 tablet_bootstrap.cc:654] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.467249 28149 raft_consensus.cc:359] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.467851 28149 raft_consensus.cc:385] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.467985 28151 tablet_bootstrap.cc:654] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.468149 28149 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.468781 28149 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.470486 28149 ts_tablet_manager.cc:1434] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:22.472069 28149 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.478217 28149 tablet_bootstrap.cc:654] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.485360 28250 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.491838 28157 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.493348 28151 tablet_bootstrap.cc:492] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.493908 28151 ts_tablet_manager.cc:1403] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.001s
I20260503 07:57:22.496106 28242 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.496572 28242 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.497992 28151 raft_consensus.cc:359] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.498391 28242 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.498629 28151 raft_consensus.cc:385] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.498874 28151 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.499408 28151 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.500252 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.500469 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:22.501461 27926 leader_election.cc:343] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.501740 28151 ts_tablet_manager.cc:1434] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260503 07:57:22.502213 27924 leader_election.cc:343] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.502653 28151 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.502630 27924 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:22.503676 28242 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:22.505371 28154 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.505743 28154 ts_tablet_manager.cc:1403] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.046s user 0.008s sys 0.007s
I20260503 07:57:22.508994 28154 raft_consensus.cc:359] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.509506 28151 tablet_bootstrap.cc:654] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.509629 28154 raft_consensus.cc:385] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.509925 28154 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.512027 28154 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.516243 28157 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.518105 28154 ts_tablet_manager.cc:1434] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.012s user 0.003s sys 0.004s
I20260503 07:57:22.519107 28242 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.519526 28242 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.521142 28242 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.522148 27855 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:22.523221 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.523592 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:22.523756 28034 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:22.524765 28149 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.524837 27926 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:22.527240 27924 leader_election.cc:343] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.528465 28242 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.528813 28242 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.529155 28242 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.532987 28151 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.533418 28151 ts_tablet_manager.cc:1403] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.031s user 0.013s sys 0.004s
I20260503 07:57:22.533885 28149 ts_tablet_manager.cc:1403] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.062s user 0.023s sys 0.011s
I20260503 07:57:22.537546 28151 raft_consensus.cc:359] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.538156 28151 raft_consensus.cc:385] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.538403 28151 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.538333 28242 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.539104 28151 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.540719 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:22.541241 28034 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.543845 28395 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.544324 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:22.544265 28395 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.542361 28352 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260503 07:57:22.545832 27924 leader_election.cc:343] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.543809 28242 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.547691 28395 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.548386 28034 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:22.548272 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.548697 28154 tablet_bootstrap.cc:492] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.549350 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:22.549578 28073 leader_election.cc:343] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.549944 28035 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:22.554420 27926 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:22.558655 28242 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.559386 28154 tablet_bootstrap.cc:654] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.559544 28075 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:22.561057 28242 raft_consensus.cc:697] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:22.561162 28395 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.561528 28395 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.561856 28395 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.562796 28242 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.571486 28154 tablet_bootstrap.cc:492] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.571862 28154 ts_tablet_manager.cc:1403] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.003s
I20260503 07:57:22.574441 28154 raft_consensus.cc:359] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.547838 28149 raft_consensus.cc:359] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.575053 28154 raft_consensus.cc:385] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.575156 28149 raft_consensus.cc:385] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.575347 28154 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.575505 28149 raft_consensus.cc:740] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.575829 28151 ts_tablet_manager.cc:1434] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.042s user 0.005s sys 0.001s
I20260503 07:57:22.575971 28154 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.578214 28154 ts_tablet_manager.cc:1434] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260503 07:57:22.578944 28154 tablet_bootstrap.cc:492] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.580163 28149 consensus_queue.cc:260] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.582222 28395 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.583779 28149 ts_tablet_manager.cc:1434] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.049s user 0.005s sys 0.000s
I20260503 07:57:22.584604 28149 tablet_bootstrap.cc:492] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.585295 28154 tablet_bootstrap.cc:654] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.585407 28151 tablet_bootstrap.cc:492] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.586872 28358 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.588912 28395 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.595054 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:22.595755 28033 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.595983 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:57:22.597813 28073 leader_election.cc:343] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.594487 28358 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.599226 28352 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.599583 28352 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.600251 28358 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.601154 28352 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.602156 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:22.602808 28109 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:22.608376 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:22.611462 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.612782 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.613296 27957 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:22.613363 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.611989 28269 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.614089 28269 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.614357 28269 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:22.617398 28073 leader_election.cc:343] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.619207 27856 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:22.626593 28033 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:22.626824 28269 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.628535 28269 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.630048 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:22.630529 28109 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.631569 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:22.632026 27955 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.632864 28151 tablet_bootstrap.cc:654] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:22.636816 28075 leader_election.cc:343] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.637277 28075 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:22.637936 28395 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:22.639009 28075 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:22.639408 27955 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:22.639688 28395 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.640112 28395 raft_consensus.cc:697] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:22.640748 28395 consensus_queue.cc:237] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.641650 28109 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:22.642513 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:22.643054 28269 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.643921 28269 raft_consensus.cc:697] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:22.645016 28269 consensus_queue.cc:237] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.654892 28151 tablet_bootstrap.cc:492] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.655282 28151 ts_tablet_manager.cc:1403] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.070s user 0.014s sys 0.004s
I20260503 07:57:22.658277 28151 raft_consensus.cc:359] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.659775 28151 raft_consensus.cc:385] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.660040 28151 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.659786 28154 tablet_bootstrap.cc:492] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.660578 28151 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.661139 28154 ts_tablet_manager.cc:1403] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.082s user 0.013s sys 0.011s
I20260503 07:57:22.662573 28151 ts_tablet_manager.cc:1434] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260503 07:57:22.663390 28151 tablet_bootstrap.cc:492] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.663908 28149 tablet_bootstrap.cc:654] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.666888 28395 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.667308 28395 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.668200 28154 raft_consensus.cc:359] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.668803 28154 raft_consensus.cc:385] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.669035 28154 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.669745 28151 tablet_bootstrap.cc:654] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.672415 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.672907 28395 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.672936 28033 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:22.671442 28154 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.674134 28075 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:22.675514 28352 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.675841 28352 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.676194 28352 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.675590 28154 ts_tablet_manager.cc:1434] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.014s user 0.000s sys 0.005s
I20260503 07:57:22.678706 28154 tablet_bootstrap.cc:492] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.678843 27855 catalog_manager.cc:5671] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:22.669598 27856 catalog_manager.cc:5671] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:22.687737 28352 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.690403 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:22.694669 28073 leader_election.cc:343] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.700115 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:57:22.701838 28073 leader_election.cc:343] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.704893 28352 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:22.709291 27956 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.712776 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:22.713344 28032 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.721661 28032 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:22.723917 28075 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:22.727927 28395 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.728376 28395 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:22.729584 28149 tablet_bootstrap.cc:492] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.730022 28149 ts_tablet_manager.cc:1403] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.146s user 0.007s sys 0.009s
I20260503 07:57:22.729178 28395 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.732858 28149 raft_consensus.cc:359] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.735581 28149 raft_consensus.cc:385] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.739730 28149 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.749632 28149 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.752193 28149 ts_tablet_manager.cc:1434] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.022s user 0.003s sys 0.001s
I20260503 07:57:22.735138 28154 tablet_bootstrap.cc:654] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.764075 28149 tablet_bootstrap.cc:492] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.770284 28149 tablet_bootstrap.cc:654] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.773984 28154 tablet_bootstrap.cc:492] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.774363 28154 ts_tablet_manager.cc:1403] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.096s user 0.007s sys 0.002s
I20260503 07:57:22.776777 28151 tablet_bootstrap.cc:492] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.777835 28154 raft_consensus.cc:359] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.779137 28154 raft_consensus.cc:385] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.779273 28151 ts_tablet_manager.cc:1403] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.116s user 0.023s sys 0.034s
I20260503 07:57:22.779428 28154 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.778857 27855 catalog_manager.cc:5671] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:22.780194 28154 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.784013 28151 raft_consensus.cc:359] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.784581 28154 ts_tablet_manager.cc:1434] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260503 07:57:22.784624 28151 raft_consensus.cc:385] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.785141 28151 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.785415 28154 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.785771 28151 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.787878 28151 ts_tablet_manager.cc:1434] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260503 07:57:22.788683 28151 tablet_bootstrap.cc:492] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.791839 28154 tablet_bootstrap.cc:654] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.798507 28149 tablet_bootstrap.cc:492] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.798909 28149 ts_tablet_manager.cc:1403] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.005s
I20260503 07:57:22.799583 28151 tablet_bootstrap.cc:654] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.801378 28149 raft_consensus.cc:359] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.802047 28149 raft_consensus.cc:385] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.802287 28149 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.802897 28149 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.803479 28447 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.805038 28149 ts_tablet_manager.cc:1434] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260503 07:57:22.804689 28447 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.806752 28447 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.808420 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:22.808539 28269 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.808786 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.808986 28269 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.809370 28033 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:22.808954 28107 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:22.810374 27926 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:22.810781 28269 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.811794 28447 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.812189 28447 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.812425 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.812569 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:22.813185 28107 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:22.813524 28154 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
W20260503 07:57:22.813712 27999 leader_election.cc:343] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.813951 28154 ts_tablet_manager.cc:1403] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.011s
I20260503 07:57:22.814432 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:22.812666 28447 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.815060 28269 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:22.815399 28269 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:22.815724 28269 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.818846 28151 tablet_bootstrap.cc:492] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.819258 28151 ts_tablet_manager.cc:1403] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.003s
I20260503 07:57:22.819631 28154 raft_consensus.cc:359] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.820266 28154 raft_consensus.cc:385] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.820514 28154 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.813700 28149 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.821092 28154 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.821628 28151 raft_consensus.cc:359] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.822356 28151 raft_consensus.cc:385] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.822636 28151 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.823333 28154 ts_tablet_manager.cc:1434] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260503 07:57:22.823239 28151 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.824196 28154 tablet_bootstrap.cc:492] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.825579 28151 ts_tablet_manager.cc:1434] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260503 07:57:22.827612 28269 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.831444 28358 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.836650 28151 tablet_bootstrap.cc:492] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.836728 28358 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.838429 28358 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.834074 28154 tablet_bootstrap.cc:654] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:22.836285 27905 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260503 07:57:22.841425 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:22.841542 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:22.843045 28269 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:22.844061 27999 leader_election.cc:343] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.845347 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:22.845407 28447 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:22.846536 27999 leader_election.cc:343] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.850085 28149 tablet_bootstrap.cc:654] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.850003 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:22.850700 28107 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.853813 28447 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.858651 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:22.859179 28109 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.864054 28149 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.864429 28149 ts_tablet_manager.cc:1403] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.051s user 0.014s sys 0.001s
I20260503 07:57:22.866591 28109 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:22.867432 27924 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:22.868336 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:22.868809 28032 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.869051 28107 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
W20260503 07:57:22.870693 27999 leader_election.cc:343] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:22.871064 27999 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:22.870749 28151 tablet_bootstrap.cc:654] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.871699 28152 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:22.871971 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:22.872219 28447 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.872639 28447 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:22.873514 28447 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.876502 28032 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:22.872643 28269 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:22.880026 28154 tablet_bootstrap.cc:492] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.880483 28154 ts_tablet_manager.cc:1403] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.056s user 0.021s sys 0.016s
I20260503 07:57:22.881343 28269 raft_consensus.cc:697] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:22.878154 28149 raft_consensus.cc:359] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.884035 28269 consensus_queue.cc:237] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.884652 28149 raft_consensus.cc:385] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.885718 28149 raft_consensus.cc:740] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.886829 28151 tablet_bootstrap.cc:492] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.886056 28154 raft_consensus.cc:359] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.887297 28151 ts_tablet_manager.cc:1403] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.007s
I20260503 07:57:22.887470 28154 raft_consensus.cc:385] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.887763 28154 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.888312 28154 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.886713 28149 consensus_queue.cc:260] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.889616 28151 raft_consensus.cc:359] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.892565 28151 raft_consensus.cc:385] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.892805 28151 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.890456 28154 ts_tablet_manager.cc:1434] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260503 07:57:22.893374 28151 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.891255 27855 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:22.895216 28151 ts_tablet_manager.cc:1434] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260503 07:57:22.891481 28447 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:22.895823 28154 tablet_bootstrap.cc:492] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.895884 28447 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.897758 28447 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:22.898607 28151 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.891327 28149 ts_tablet_manager.cc:1434] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260503 07:57:22.899696 28149 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.900213 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:22.904577 27956 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:22.906674 28149 tablet_bootstrap.cc:654] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.907150 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:22.907060 27855 catalog_manager.cc:5671] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:22.909381 27924 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:22.910032 28447 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:22.912664 28151 tablet_bootstrap.cc:654] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.913793 28154 tablet_bootstrap.cc:654] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.919752 28395 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.923300 28149 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:22.923840 28149 ts_tablet_manager.cc:1403] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.001s
I20260503 07:57:22.926456 28149 raft_consensus.cc:359] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.927177 28149 raft_consensus.cc:385] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.927863 28149 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.928452 28149 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.931986 28149 ts_tablet_manager.cc:1434] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260503 07:57:22.932467 28154 tablet_bootstrap.cc:492] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:22.932950 28154 ts_tablet_manager.cc:1403] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.006s
I20260503 07:57:22.933446 28149 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:22.935331 28154 raft_consensus.cc:359] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.935983 28154 raft_consensus.cc:385] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.936295 28154 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.936988 28154 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.940135 28154 ts_tablet_manager.cc:1434] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.001s sys 0.003s
I20260503 07:57:22.942404 28154 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:22.944263 28151 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:22.944664 28151 ts_tablet_manager.cc:1403] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.046s user 0.016s sys 0.002s
I20260503 07:57:22.947134 28151 raft_consensus.cc:359] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.947695 28151 raft_consensus.cc:385] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:22.947968 28151 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:22.948792 28154 tablet_bootstrap.cc:654] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.940971 28149 tablet_bootstrap.cc:654] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:22.948520 28151 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:22.951375 28151 ts_tablet_manager.cc:1434] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260503 07:57:22.953311 28151 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:22.954156 28250 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:22.965641 28151 tablet_bootstrap.cc:654] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:23.073101 28075 consensus_peers.cc:597] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 -> Peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Couldn't send request to peer adaf84b6ac60420ab03d39b9db9f0413. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:57:23.073511 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 85972.7us
I20260503 07:57:23.074743 28154 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:23.075217 28154 ts_tablet_manager.cc:1403] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.133s user 0.006s sys 0.013s
I20260503 07:57:23.075886 28151 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:23.076313 28151 ts_tablet_manager.cc:1403] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.124s user 0.009s sys 0.004s
I20260503 07:57:23.077075 28352 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.074743 28250 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.077572 28352 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.079698 28352 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.077749 28250 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.081404 28250 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.079290 28154 raft_consensus.cc:359] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.082020 28154 raft_consensus.cc:385] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.082302 28154 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.082854 28154 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.084427 28154 ts_tablet_manager.cc:1434] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260503 07:57:23.085038 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.085667 28151 raft_consensus.cc:359] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.086344 28151 raft_consensus.cc:385] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.086601 28151 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.087007 28149 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:23.087292 28250 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.087409 28149 ts_tablet_manager.cc:1403] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.154s user 0.008s sys 0.023s
I20260503 07:57:23.087180 28151 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.087688 28250 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.089555 28250 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.089838 28149 raft_consensus.cc:359] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.091610 28149 raft_consensus.cc:385] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.091817 28151 ts_tablet_manager.cc:1434] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20260503 07:57:23.091836 28149 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.092700 28149 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.094017 28151 tablet_bootstrap.cc:492] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:23.094237 28447 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.099960 28154 tablet_bootstrap.cc:492] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:23.096102 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.095110 28149 ts_tablet_manager.cc:1434] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:57:23.101965 28149 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:23.103652 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.104424 28032 raft_consensus.cc:2393] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 1: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:23.105466 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.099298 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.107031 28152 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.109212 28149 tablet_bootstrap.cc:654] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:23.115712 28073 consensus_peers.cc:597] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:57:23.116246 28073 leader_election.cc:343] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:23.116773 28073 leader_election.cc:343] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.115569 28475 consensus_queue.cc:1048] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.120483 28151 tablet_bootstrap.cc:654] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.120628 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.121847 28154 tablet_bootstrap.cc:654] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.142000 28075 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:57:23.143399 28075 leader_election.cc:343] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.143916 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:23.153402 28395 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.157298 28242 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.157757 28242 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.159646 28242 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.162245 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.163020 28033 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:23.163226 28477 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.164453 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.166060 27926 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:23.166762 28075 leader_election.cc:343] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.167007 28447 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.167204 28075 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:23.167913 28477 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.172469 27957 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.173777 28395 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.175318 28447 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.177310 28447 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.178190 28477 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.178602 28477 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.180371 28477 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.181720 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.182324 27956 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:23.183048 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.183808 28073 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:23.184725 28149 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:23.184880 28395 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:23.185165 28149 ts_tablet_manager.cc:1403] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.083s user 0.018s sys 0.023s
I20260503 07:57:23.185217 28395 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:23.185626 28395 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.187984 28149 raft_consensus.cc:359] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.188637 28149 raft_consensus.cc:385] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.188897 28149 raft_consensus.cc:740] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
W20260503 07:57:23.184756 28075 leader_election.cc:343] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.189476 28149 consensus_queue.cc:260] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.191445 28149 ts_tablet_manager.cc:1434] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260503 07:57:23.192258 28149 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:23.195152 28417 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.195757 28417 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.196529 28395 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.197260 28152 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.197686 28152 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.198524 28417 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.199276 28152 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.200012 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.201836 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:23.203312 28075 leader_election.cc:343] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.204043 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.203753 28149 tablet_bootstrap.cc:654] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.204720 28151 tablet_bootstrap.cc:492] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:23.205186 28151 ts_tablet_manager.cc:1403] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.111s user 0.024s sys 0.013s
W20260503 07:57:23.205852 27999 leader_election.cc:343] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:23.206470 27999 leader_election.cc:343] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.198860 28395 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.207924 28151 raft_consensus.cc:359] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.208550 28151 raft_consensus.cc:385] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.212774 28149 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:23.213141 28149 ts_tablet_manager.cc:1403] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.000s
I20260503 07:57:23.216390 28149 raft_consensus.cc:359] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.217217 28149 raft_consensus.cc:385] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.217568 28149 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.218293 28149 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.208786 28151 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.221107 28149 ts_tablet_manager.cc:1434] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260503 07:57:23.222191 28149 tablet_bootstrap.cc:492] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:23.223567 28476 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.229815 28149 tablet_bootstrap.cc:654] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.231571 28151 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.236027 28151 ts_tablet_manager.cc:1434] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20260503 07:57:23.236893 28151 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:23.241753 28154 tablet_bootstrap.cc:492] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:23.242288 28154 ts_tablet_manager.cc:1403] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.143s user 0.012s sys 0.000s
I20260503 07:57:23.244591 28154 raft_consensus.cc:359] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.255776 28154 raft_consensus.cc:385] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.256856 28154 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.266032 28152 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.266630 28152 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.270874 28152 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.270469 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:23.271540 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.288766 27956 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.265676 28154 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:23.290957 27999 leader_election.cc:343] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.272958 28151 tablet_bootstrap.cc:654] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.304034 28154 ts_tablet_manager.cc:1434] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.061s user 0.005s sys 0.000s
I20260503 07:57:23.304231 28149 tablet_bootstrap.cc:492] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:23.304698 28149 ts_tablet_manager.cc:1403] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.083s user 0.012s sys 0.020s
I20260503 07:57:23.307459 28154 tablet_bootstrap.cc:492] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:23.299443 28475 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260503 07:57:23.311118 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.318959 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.319415 28109 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:23.322259 28242 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.318318 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.327864 28108 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.332079 28154 tablet_bootstrap.cc:654] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.342144 28149 raft_consensus.cc:359] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.342806 28149 raft_consensus.cc:385] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.343976 28149 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.344805 28149 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.352694 28149 ts_tablet_manager.cc:1434] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
I20260503 07:57:23.353492 28149 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:23.365272 27956 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:23.366387 28151 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:23.369483 28151 ts_tablet_manager.cc:1403] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.133s user 0.015s sys 0.008s
I20260503 07:57:23.379042 28073 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:23.372035 28358 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.382026 28477 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:23.381430 28358 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.387737 28477 raft_consensus.cc:697] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:23.391628 28358 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.393127 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.392906 28477 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:23.394284 27999 leader_election.cc:343] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.406499 28151 raft_consensus.cc:359] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.407183 28149 tablet_bootstrap.cc:654] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.407397 28151 raft_consensus.cc:385] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.407806 28151 raft_consensus.cc:740] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.425055 28447 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.408515 28151 consensus_queue.cc:260] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.442567 28151 ts_tablet_manager.cc:1434] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.073s user 0.005s sys 0.003s
W20260503 07:57:23.450031 27999 consensus_peers.cc:597] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:23.451809 28151 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:23.450460 28417 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260503 07:57:23.454934 28154 tablet_bootstrap.cc:492] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:23.455349 28154 ts_tablet_manager.cc:1403] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.150s user 0.011s sys 0.011s
I20260503 07:57:23.455585 28447 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.458611 28154 raft_consensus.cc:359] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.459277 28154 raft_consensus.cc:385] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.461704 28154 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
W20260503 07:57:23.461865 27999 leader_election.cc:343] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.462266 27999 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:23.463337 28358 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.459281 28447 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.470331 28447 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.464015 28154 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.476454 28154 ts_tablet_manager.cc:1434] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20260503 07:57:23.473124 27856 catalog_manager.cc:5671] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:23.481153 28154 tablet_bootstrap.cc:492] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:23.485201 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:23.485880 28417 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:23.486222 28417 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:23.486320 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.486604 28417 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.486943 28033 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
W20260503 07:57:23.487758 27999 leader_election.cc:343] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.488147 27999 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:23.488801 28152 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.489554 28491 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260503 07:57:23.497082 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.498391 28417 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.499548 28447 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.500569 28149 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:23.500950 28149 ts_tablet_manager.cc:1403] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.148s user 0.007s sys 0.010s
I20260503 07:57:23.505564 27926 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:23.500140 28417 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.509441 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.509967 28151 tablet_bootstrap.cc:654] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.512632 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:23.500094 28447 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.510862 28242 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:23.519634 28242 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:23.520088 28242 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.524550 28447 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.546241 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.546213 28487 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.555891 28151 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:23.555553 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.560050 28151 ts_tablet_manager.cc:1403] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.108s user 0.011s sys 0.003s
I20260503 07:57:23.559769 28487 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.561196 28149 raft_consensus.cc:359] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.561851 28149 raft_consensus.cc:385] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260503 07:57:23.549244 27924 leader_election.cc:343] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.566718 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:23.567294 28107 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:23.560889 27999 leader_election.cc:343] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.569283 28149 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.570297 28149 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.573487 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:23.574337 28154 tablet_bootstrap.cc:654] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.574750 28501 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:57:23.577406 27999 leader_election.cc:343] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.577785 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:23.579195 28152 consensus_queue.cc:1048] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:23.569661 28491 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.580251 28487 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.580381 28149 ts_tablet_manager.cc:1434] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.079s user 0.003s sys 0.004s
I20260503 07:57:23.579994 28107 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:23.580444 28491 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.580766 28151 raft_consensus.cc:359] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.581430 28151 raft_consensus.cc:385] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.581709 28151 raft_consensus.cc:740] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.582494 28417 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.582846 28491 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.582234 28151 consensus_queue.cc:260] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.584709 28151 ts_tablet_manager.cc:1434] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260503 07:57:23.585489 28151 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:23.559352 28242 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.587349 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:23.588518 28073 leader_election.cc:343] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.588583 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.589174 28107 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:23.589946 28149 tablet_bootstrap.cc:492] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:23.592736 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:23.594879 28487 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:23.595230 28487 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:23.595511 28487 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.593488 28242 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.600755 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:23.601317 28030 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.609200 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.610860 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:23.612269 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:23.613463 28152 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:23.613873 28152 raft_consensus.cc:697] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:23.614600 28152 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.615624 28487 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:23.617877 27926 leader_election.cc:343] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:23.613889 27924 leader_election.cc:343] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.620189 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.620775 28035 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:23.620779 28151 tablet_bootstrap.cc:654] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.621506 27956 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.622659 28075 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:23.631947 28149 tablet_bootstrap.cc:654] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.629362 28491 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:23.633380 28491 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:23.633766 28491 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.632668 28030 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:23.636999 28358 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.637463 28358 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.640007 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.641508 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.641947 28487 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.643191 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:23.643380 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:23.639212 28358 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.644583 28417 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.645987 28154 tablet_bootstrap.cc:492] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:23.643381 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:23.646078 27926 leader_election.cc:343] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.646472 28154 ts_tablet_manager.cc:1403] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.166s user 0.012s sys 0.011s
I20260503 07:57:23.646435 28107 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.646744 27926 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:23.648861 28487 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:23.650499 28487 raft_consensus.cc:697] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:23.651257 28487 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.654129 28107 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:23.661255 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:23.662303 28242 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:23.662714 28242 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:23.663456 28242 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.665513 28151 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:23.666072 28151 ts_tablet_manager.cc:1403] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.081s user 0.007s sys 0.004s
I20260503 07:57:23.667989 27857 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:23.750090 28358 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.750720 28358 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.756685 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:23.780225 27999 leader_election.cc:343] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.756676 28358 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.783784 28491 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.785125 28151 raft_consensus.cc:359] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.785753 28151 raft_consensus.cc:385] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.785908 28154 raft_consensus.cc:359] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.786659 28154 raft_consensus.cc:385] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.786016 28151 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.787325 28151 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.789307 28151 ts_tablet_manager.cc:1434] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.123s user 0.008s sys 0.000s
I20260503 07:57:23.789948 28154 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.791635 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:23.791940 28149 tablet_bootstrap.cc:492] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:23.792328 28149 ts_tablet_manager.cc:1403] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.211s user 0.032s sys 0.025s
I20260503 07:57:23.790580 28154 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:23.795329 27999 leader_election.cc:343] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.798516 27999 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:23.802721 28152 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:23.812011 28154 ts_tablet_manager.cc:1434] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.165s user 0.003s sys 0.008s
I20260503 07:57:23.812691 28149 raft_consensus.cc:359] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.813503 28149 raft_consensus.cc:385] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:23.813805 28149 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:23.817636 28151 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:23.814518 28149 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:23.805425 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 105416us
I20260503 07:57:23.830451 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:23.830967 28034 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:23.837394 28034 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:23.838128 28149 ts_tablet_manager.cc:1434] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.046s user 0.006s sys 0.000s
I20260503 07:57:23.839214 28149 tablet_bootstrap.cc:492] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:23.824717 28491 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.858727 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:23.863564 28154 tablet_bootstrap.cc:492] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:23.866881 28358 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.867367 28358 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.884087 28395 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.889084 28395 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:23.896158 28073 leader_election.cc:343] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:23.899084 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 74314.7us
I20260503 07:57:23.901180 28075 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:23.901741 28250 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:23.902263 28250 raft_consensus.cc:697] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:23.905133 28250 consensus_queue.cc:237] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.937343 28477 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:23.938310 28477 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:23.939785 28149 tablet_bootstrap.cc:654] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.940054 28477 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.945593 28151 tablet_bootstrap.cc:654] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:23.950588 28395 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:23.952450 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.953030 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:23.954216 28073 leader_election.cc:343] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:23.955158 28073 leader_election.cc:343] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:23.977603 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 82645.5us
I20260503 07:57:23.985607 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:23.989185 28358 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:23.993958 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:23.997895 28151 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:23.998319 28151 ts_tablet_manager.cc:1403] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.182s user 0.005s sys 0.008s
I20260503 07:57:23.977227 28520 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260503 07:57:24.001631 28035 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
W20260503 07:57:24.005193 27999 leader_election.cc:343] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:23.995973 28030 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:24.007709 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.002700 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.008198 28109 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:24.008489 28031 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:24.009784 28075 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.010280 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.010946 28152 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:24.011255 28152 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:24.011523 28152 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.012596 28477 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:24.012961 28477 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:24.013814 28477 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.016009 28075 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.022223 28250 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:24.022552 28250 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:24.018209 28152 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.022836 28250 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.023710 28152 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.020328 28151 raft_consensus.cc:359] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.025913 28151 raft_consensus.cc:385] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.026162 28151 raft_consensus.cc:740] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.021884 28477 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.026921 28151 consensus_queue.cc:260] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.029148 28151 ts_tablet_manager.cc:1434] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.031s user 0.004s sys 0.002s
I20260503 07:57:24.029654 28477 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:24.030642 28250 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.031476 28151 tablet_bootstrap.cc:492] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:24.034534 28250 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:24.034710 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:24.036746 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:24.036898 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:24.037094 27999 leader_election.cc:343] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:24.037300 28108 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.037567 28032 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.038897 28447 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.040205 28447 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.042133 28447 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.042743 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:24.043735 28031 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.044535 28032 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:24.046667 28154 tablet_bootstrap.cc:654] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.060949 28031 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:24.068415 28149 tablet_bootstrap.cc:492] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:24.076408 27855 catalog_manager.cc:5671] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:24.080960 27857 catalog_manager.cc:5671] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:24.139304 28149 ts_tablet_manager.cc:1403] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.300s user 0.007s sys 0.011s
I20260503 07:57:24.084137 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:24.139814 27857 catalog_manager.cc:5671] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:24.072444 28108 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:24.072613 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:57:24.152705 28073 leader_election.cc:343] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:24.164935 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.182163 28149 raft_consensus.cc:359] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.183012 28149 raft_consensus.cc:385] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.183328 28149 raft_consensus.cc:740] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.184016 28149 consensus_queue.cc:260] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.192886 28149 ts_tablet_manager.cc:1434] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.053s user 0.004s sys 0.003s
I20260503 07:57:24.193400 28075 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:24.194130 28149 tablet_bootstrap.cc:492] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:24.194720 28491 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:24.196105 28151 tablet_bootstrap.cc:654] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:24.196448 28075 consensus_peers.cc:597] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 -> Peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Couldn't send request to peer adaf84b6ac60420ab03d39b9db9f0413. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:24.197609 28075 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.197332 28491 raft_consensus.cc:697] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:24.202457 27960 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.204473 28491 consensus_queue.cc:237] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.208359 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.213131 28520 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:24.213619 28520 raft_consensus.cc:697] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:57:24.237417 28073 leader_election.cc:343] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:24.214452 28520 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.257124 28154 tablet_bootstrap.cc:492] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.257592 28154 ts_tablet_manager.cc:1403] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.394s user 0.016s sys 0.026s
I20260503 07:57:24.257932 28518 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:57:24.268749 27926 consensus_peers.cc:597] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 -> Peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Couldn't send request to peer adaf84b6ac60420ab03d39b9db9f0413. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:24.269302 27926 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:24.258471 28518 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.270550 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.282368 28149 tablet_bootstrap.cc:654] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
W20260503 07:57:24.282289 27999 consensus_peers.cc:597] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:24.291682 28154 raft_consensus.cc:359] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.293605 28522 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:24.294112 28522 raft_consensus.cc:697] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:24.294396 28518 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.295552 28154 raft_consensus.cc:385] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.275554 28242 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260503 07:57:24.295917 28154 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.294893 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:24.296917 28151 tablet_bootstrap.cc:492] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:24.289268 28035 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.283383 28269 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260503 07:57:24.301569 28151 ts_tablet_manager.cc:1403] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.270s user 0.019s sys 0.007s
I20260503 07:57:24.302932 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.305008 28151 raft_consensus.cc:359] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.305769 28151 raft_consensus.cc:385] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.306062 28151 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.305176 28447 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:24.310092 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:24.306725 28151 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.294940 28522 consensus_queue.cc:237] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:24.312803 27924 consensus_peers.cc:597] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 -> Peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): Couldn't send request to peer be26cebb7c90445ea9a74f66463457c1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:24.297552 28154 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:24.324726 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 54777.1us
I20260503 07:57:24.333591 27855 catalog_manager.cc:5671] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:24.340401 28447 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:24.341235 28154 ts_tablet_manager.cc:1434] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.083s user 0.007s sys 0.000s
I20260503 07:57:24.342139 28154 tablet_bootstrap.cc:492] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.345973 28151 ts_tablet_manager.cc:1434] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260503 07:57:24.346808 28151 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:24.360735 28521 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260503 07:57:24.373116 27905 auto_rebalancer.cc:258] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260503 07:57:24.375169 28073 consensus_peers.cc:597] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:24.376619 27857 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:24.427706 28352 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.430428 28352 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.432092 28154 tablet_bootstrap.cc:654] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.432687 28352 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:24.443076 27855 catalog_manager.cc:5671] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:24.452708 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.446966 28475 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260503 07:57:24.474941 28151 tablet_bootstrap.cc:654] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.477357 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:24.467576 28031 raft_consensus.cc:2468] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
W20260503 07:57:24.481475 28073 leader_election.cc:343] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
W20260503 07:57:24.487072 28537 log.cc:927] Time spent T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.081s user 0.004s sys 0.000s
I20260503 07:57:24.493280 28149 tablet_bootstrap.cc:492] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:24.493697 28149 ts_tablet_manager.cc:1403] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.300s user 0.026s sys 0.020s
I20260503 07:57:24.495997 28149 raft_consensus.cc:359] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.496600 28149 raft_consensus.cc:385] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.501587 28151 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:24.501986 28151 ts_tablet_manager.cc:1403] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.155s user 0.008s sys 0.003s
I20260503 07:57:24.504360 28151 raft_consensus.cc:359] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.504962 28151 raft_consensus.cc:385] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.505275 28151 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.505826 28151 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.508704 28151 ts_tablet_manager.cc:1434] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260503 07:57:24.509542 28151 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:24.515743 28075 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.516702 28491 raft_consensus.cc:2804] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:24.517068 28491 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:24.517385 28491 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.519368 28151 tablet_bootstrap.cc:654] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.526319 28151 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:24.526686 28151 ts_tablet_manager.cc:1403] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260503 07:57:24.528863 28151 raft_consensus.cc:359] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.529479 28151 raft_consensus.cc:385] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.529732 28151 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.530274 28151 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.496833 28149 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.532552 28154 tablet_bootstrap.cc:492] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.532931 28154 ts_tablet_manager.cc:1403] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.191s user 0.009s sys 0.017s
I20260503 07:57:24.535349 28154 raft_consensus.cc:359] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.535917 28154 raft_consensus.cc:385] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.536159 28154 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.536844 28154 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.538756 28154 ts_tablet_manager.cc:1434] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260503 07:57:24.539536 28154 tablet_bootstrap.cc:492] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.545320 28149 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.545985 28491 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.547282 28149 ts_tablet_manager.cc:1434] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.053s user 0.002s sys 0.002s
I20260503 07:57:24.547948 28149 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:24.548590 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:57:24.549894 28073 leader_election.cc:343] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:24.553136 28154 tablet_bootstrap.cc:654] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.556845 28151 ts_tablet_manager.cc:1434] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20260503 07:57:24.557301 28149 tablet_bootstrap.cc:654] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.564566 28149 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:24.565158 28149 ts_tablet_manager.cc:1403] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.004s
I20260503 07:57:24.569167 28149 raft_consensus.cc:359] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.569833 28149 raft_consensus.cc:385] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.570093 28149 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.574484 28154 tablet_bootstrap.cc:492] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.574910 28154 ts_tablet_manager.cc:1403] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.004s
I20260503 07:57:24.570624 28149 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.577018 28149 ts_tablet_manager.cc:1434] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260503 07:57:24.577299 28154 raft_consensus.cc:359] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.577832 28149 tablet_bootstrap.cc:492] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:24.577914 28154 raft_consensus.cc:385] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.578233 28154 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.578725 28154 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.580387 28154 ts_tablet_manager.cc:1434] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260503 07:57:24.583046 28491 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:24.585392 28151 tablet_bootstrap.cc:492] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Bootstrap starting.
I20260503 07:57:24.593194 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:24.593724 28031 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.595353 28151 tablet_bootstrap.cc:654] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.600324 28447 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.600368 28031 raft_consensus.cc:2468] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:24.600842 28447 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.603331 28075 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.605065 28475 raft_consensus.cc:2804] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:24.605418 28154 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.605471 28475 raft_consensus.cc:697] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:24.606241 28475 consensus_queue.cc:237] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.608520 28521 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.608865 28521 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.610435 28521 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.611115 28154 tablet_bootstrap.cc:654] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.611093 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:24.611764 27960 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:24.612826 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:24.613595 28521 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:24.613935 28521 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:24.614279 28521 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.614720 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.615312 28106 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 0.
I20260503 07:57:24.618315 28447 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.618896 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.619444 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.619985 28107 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:24.620286 28154 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.620668 28154 ts_tablet_manager.cc:1403] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.008s
I20260503 07:57:24.623484 28154 raft_consensus.cc:359] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.621340 28149 tablet_bootstrap.cc:654] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.628325 28154 raft_consensus.cc:385] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.628674 28154 raft_consensus.cc:740] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.620965 28521 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.629495 28031 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:24.629241 28154 consensus_queue.cc:260] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.631099 28154 ts_tablet_manager.cc:1434] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.010s user 0.006s sys 0.003s
I20260503 07:57:24.632210 28154 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.634685 28521 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.637794 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:24.638309 27960 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.638386 28154 tablet_bootstrap.cc:654] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.640157 28151 tablet_bootstrap.cc:492] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: No bootstrap required, opened a new log
I20260503 07:57:24.640528 28151 ts_tablet_manager.cc:1403] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Time spent bootstrapping tablet: real 0.055s user 0.012s sys 0.000s
I20260503 07:57:24.644209 28151 raft_consensus.cc:359] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.645032 28151 raft_consensus.cc:385] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.645388 28151 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.645905 27960 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:24.646113 28151 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.651835 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:24.652277 28107 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.654214 28151 ts_tablet_manager.cc:1434] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Time spent starting tablet: real 0.013s user 0.003s sys 0.003s
I20260503 07:57:24.625995 27924 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:24.657060 28149 tablet_bootstrap.cc:492] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
I20260503 07:57:24.657629 28149 ts_tablet_manager.cc:1403] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.080s user 0.016s sys 0.005s
I20260503 07:57:24.659644 28242 raft_consensus.cc:2764] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260503 07:57:24.659853 28149 raft_consensus.cc:359] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.660629 28149 raft_consensus.cc:385] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.660902 28149 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.661698 28149 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.665602 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:24.668694 28543 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:24.669130 28543 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:24.670393 28250 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.670302 28543 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.670882 28250 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.673251 28149 ts_tablet_manager.cc:1434] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260503 07:57:24.674161 28149 tablet_bootstrap.cc:492] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Bootstrap starting.
I20260503 07:57:24.677385 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.678123 28031 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 0.
I20260503 07:57:24.672910 28250 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:24.682632 28075 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:24.685633 28149 tablet_bootstrap.cc:654] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.684036 28520 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:24.693954 28520 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:24.694273 28520 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.694623 28154 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.695004 28154 ts_tablet_manager.cc:1403] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.063s user 0.032s sys 0.024s
I20260503 07:57:24.697641 28154 raft_consensus.cc:359] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.698240 28154 raft_consensus.cc:385] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.698480 28154 raft_consensus.cc:740] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.698365 27856 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 0 to 1, leader changed from <none> to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:24.699177 28154 consensus_queue.cc:260] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.700387 28520 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:24.687498 28073 consensus_peers.cc:597] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 -> Peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Couldn't send request to peer 37e72845941344c9b0aaa7235a6f4473. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:24.701476 28154 ts_tablet_manager.cc:1434] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260503 07:57:24.702405 28154 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.703516 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:24.704699 28106 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.707818 28154 tablet_bootstrap.cc:654] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.691556 28107 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
W20260503 07:57:24.712364 28073 leader_election.cc:343] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:24.712440 27857 catalog_manager.cc:5671] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:24.716429 28520 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:24.718446 27956 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.721961 28520 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:24.722425 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:24.722926 28035 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.728268 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:24.729034 28035 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:24.739375 28269 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:24.730959 28149 tablet_bootstrap.cc:492] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: No bootstrap required, opened a new log
W20260503 07:57:24.731487 28073 leader_election.cc:343] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): Illegal state: must be running to vote when last-logged opid is not known
I20260503 07:57:24.746304 28075 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:24.747367 28477 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:24.747887 28477 raft_consensus.cc:697] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:24.748502 28149 ts_tablet_manager.cc:1403] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.002s
I20260503 07:57:24.748661 28477 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.750779 28149 raft_consensus.cc:359] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.751322 28149 raft_consensus.cc:385] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.751547 28149 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.752063 28149 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.754279 28149 ts_tablet_manager.cc:1434] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260503 07:57:24.767055 28154 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.767630 28154 ts_tablet_manager.cc:1403] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.065s user 0.026s sys 0.020s
I20260503 07:57:24.781492 28154 raft_consensus.cc:359] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.781944 28154 raft_consensus.cc:385] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.782163 28154 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.782754 28154 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.786360 28154 ts_tablet_manager.cc:1434] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.018s user 0.003s sys 0.004s
I20260503 07:57:24.790311 28447 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.790707 28447 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.792505 28447 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.794080 28154 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.794397 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.796237 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.796908 28035 raft_consensus.cc:2393] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:24.802070 28154 tablet_bootstrap.cc:654] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.803025 27926 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:24.804257 28242 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.806196 28521 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:24.809290 28417 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.809696 28417 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.810619 28154 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.811136 28154 ts_tablet_manager.cc:1403] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.001s
I20260503 07:57:24.811434 28417 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.813983 28154 raft_consensus.cc:359] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.814603 28154 raft_consensus.cc:385] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.814872 28154 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.815303 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:24.815481 28154 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.817996 28154 ts_tablet_manager.cc:1434] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260503 07:57:24.817698 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.816946 28242 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:24.819860 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:24.820595 28543 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:24.823805 28154 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.824827 27857 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:24.829491 28154 tablet_bootstrap.cc:654] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.836961 28154 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.837381 28154 ts_tablet_manager.cc:1403] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260503 07:57:24.839736 28154 raft_consensus.cc:359] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.840322 28154 raft_consensus.cc:385] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.840549 28154 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.841084 28154 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.842958 28154 ts_tablet_manager.cc:1434] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:24.843744 28154 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473: Bootstrap starting.
I20260503 07:57:24.849539 28154 tablet_bootstrap.cc:654] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473: Neither blocks nor log segments found. Creating new log.
I20260503 07:57:24.854534 28154 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473: No bootstrap required, opened a new log
I20260503 07:57:24.854916 28154 ts_tablet_manager.cc:1403] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260503 07:57:24.855490 28533 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:24.857214 28154 raft_consensus.cc:359] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.857800 28154 raft_consensus.cc:385] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260503 07:57:24.858021 28154 raft_consensus.cc:740] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Initialized, Role: FOLLOWER
I20260503 07:57:24.858601 28154 consensus_queue.cc:260] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.860446 28154 ts_tablet_manager.cc:1434] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260503 07:57:24.860728 28242 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.861202 28242 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.862949 28242 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.865130 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.865676 28107 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:24.867550 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.868079 28035 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 0.
I20260503 07:57:24.868563 27924 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:24.869402 28242 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260503 07:57:24.869858 28242 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:24.870335 28242 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.869467 27954 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.879355 28242 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.880887 28242 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.882483 28475 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:24.889537 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:24.890000 28107 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.895103 28447 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.895450 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:24.895565 28447 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.896023 28029 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.899194 28447 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.900146 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.900893 28035 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.899650 27954 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.905084 28107 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:24.905956 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.906141 27924 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:24.908396 27926 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:24.912163 28029 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:24.913478 28487 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader election won for term 1
I20260503 07:57:24.913924 28487 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:24.914987 28487 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.917827 28447 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:24.941447 27856 catalog_manager.cc:5671] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:24.959949 28487 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:24.960621 28487 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:24.961938 28487 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:24.962679 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:24.962843 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:24.963407 28035 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 1: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:24.964438 27926 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:24.964993 28487 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:24.970073 28487 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:25.036592 28029 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:25.051892 28543 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:25.068770 28543 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:25.079603 27960 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:25.095434 28242 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:25.095820 28242 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:25.097553 28242 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:25.098253 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:25.098413 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:25.099784 27924 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:25.100426 28242 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260503 07:57:25.103557 26792 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260503 07:57:25.109001 28573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:57:25.111502 28574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260503 07:57:25.111931 28576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260503 07:57:25.114744 26792 server_base.cc:1061] running on GCE node
I20260503 07:57:25.115628 26792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260503 07:57:25.115839 26792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260503 07:57:25.116036 26792 hybrid_clock.cc:648] HybridClock initialized: now 1777795045116015 us; error 0 us; skew 500 ppm
I20260503 07:57:25.116513 26792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260503 07:57:25.119674 26792 webserver.cc:492] Webserver started at http://127.26.42.4:46329/ using document root <none> and password file <none>
I20260503 07:57:25.120146 26792 fs_manager.cc:362] Metadata directory not provided
I20260503 07:57:25.120349 26792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260503 07:57:25.120625 26792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260503 07:57:25.122159 26792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-3-root/instance:
uuid: "25017111886b42cfa5701a39de59b6ad"
format_stamp: "Formatted at 2026-05-03 07:57:25 on dist-test-slave-pd7x"
I20260503 07:57:25.127748 26792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260503 07:57:25.131275 28581 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:25.132097 26792 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260503 07:57:25.132375 26792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-3-root
uuid: "25017111886b42cfa5701a39de59b6ad"
format_stamp: "Formatted at 2026-05-03 07:57:25 on dist-test-slave-pd7x"
I20260503 07:57:25.132632 26792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260503 07:57:25.165416 28533 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:25.175252 28533 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:25.176154 26792 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260503 07:57:25.177810 27954 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 0 FOLLOWER]: Advancing to term 1
I20260503 07:57:25.177999 26792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260503 07:57:25.196096 26792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260503 07:57:25.215145 26792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260503 07:57:25.215463 26792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:25.215813 26792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260503 07:57:25.216068 26792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260503 07:57:25.311158 28475 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:25.344138 28477 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260503 07:57:25.346962 26792 rpc_server.cc:307] RPC server started. Bound to: 127.26.42.4:46367
I20260503 07:57:25.347077 28647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.42.4:46367 every 8 connection(s)
I20260503 07:57:25.372223 26792 auto_leader_rebalancer-test.cc:417] add a tserver: 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:25.387190 28648 heartbeater.cc:344] Connected to a master server at 127.26.42.62:41751
I20260503 07:57:25.387589 28648 heartbeater.cc:461] Registering TS with master...
I20260503 07:57:25.388538 28648 heartbeater.cc:507] Master 127.26.42.62:41751 requested a full tablet report, sending...
I20260503 07:57:25.390391 27855 ts_manager.cc:194] Registered new tserver with Master: 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:25.391952 27855 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53082
I20260503 07:57:25.473287 28512 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:25.482738 28487 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260503 07:57:26.394084 28648 heartbeater.cc:499] Master 127.26.42.62:41751 was elected leader, sending a full tablet report...
I20260503 07:57:26.500936 28106 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:26.510094 27960 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:26.512377 28250 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:26.512888 28029 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:26.516390 28250 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260503 07:57:26.525339 28073 consensus_peers.cc:597] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9196b781b73d42de863558f5a560cce2. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:26.524983 27960 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.523658 28250 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.526774 28029 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.542459 27855 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:26.558811 28029 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:26.568120 28106 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:26.571039 28269 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:26.571419 27954 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:26.575644 28417 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:26.579624 28671 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.581503 28106 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.585147 27954 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.592526 28029 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:26.596225 27857 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:26.608175 28106 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:26.610975 28269 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260503 07:57:26.618598 27999 consensus_peers.cc:597] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28731014d42b4316af0150b0e98f6152. This is attempt 1: this message will repeat every 5th retry.
W20260503 07:57:26.619158 27999 consensus_peers.cc:597] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 836271c3803e4270aeffc67aeb7df764. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:26.619278 27954 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:26.620397 28417 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:26.634460 28269 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.635762 28108 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.638095 27954 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.649863 28108 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:26.654281 27857 catalog_manager.cc:5671] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.657346 28029 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260503 07:57:26.657421 28073 consensus_peers.cc:597] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9cb650978e344c697c44de57e4393e6. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:26.658681 28250 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:26.659505 27954 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:26.661166 28250 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:26.674669 28477 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.676028 28029 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.684511 27954 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:26.733364 27856 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:26.982899 28684 ts_tablet_manager.cc:933] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:26.986515 28684 tablet_copy_client.cc:323] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.2:41375
I20260503 07:57:27.002564 28045 tablet_copy_service.cc:140] P adaf84b6ac60420ab03d39b9db9f0413: Received BeginTabletCopySession request for tablet 28731014d42b4316af0150b0e98f6152 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:43620)
I20260503 07:57:27.003196 28045 tablet_copy_service.cc:161] P adaf84b6ac60420ab03d39b9db9f0413: Beginning new tablet copy session on tablet 28731014d42b4316af0150b0e98f6152 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:43620: session id = 25017111886b42cfa5701a39de59b6ad-28731014d42b4316af0150b0e98f6152
I20260503 07:57:27.010149 28045 tablet_copy_source_session.cc:215] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:27.013607 28684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28731014d42b4316af0150b0e98f6152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:27.027597 28684 tablet_copy_client.cc:806] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:27.028245 28684 tablet_copy_client.cc:670] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:27.032003 28684 tablet_copy_client.cc:538] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:27.039427 28684 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:27.062597 28684 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:27.063434 28684 tablet_bootstrap.cc:492] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:27.064043 28684 ts_tablet_manager.cc:1403] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.007s
I20260503 07:57:27.067109 28684 raft_consensus.cc:359] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.067754 28684 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:27.068341 28684 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.071569 28684 ts_tablet_manager.cc:1434] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
I20260503 07:57:27.073194 28045 tablet_copy_service.cc:342] P adaf84b6ac60420ab03d39b9db9f0413: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-28731014d42b4316af0150b0e98f6152 received from {username='slave'} at 127.0.0.1:43620
I20260503 07:57:27.073698 28045 tablet_copy_service.cc:434] P adaf84b6ac60420ab03d39b9db9f0413: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-28731014d42b4316af0150b0e98f6152 on tablet 28731014d42b4316af0150b0e98f6152 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:27.086396 28684 ts_tablet_manager.cc:933] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:27.087805 28684 tablet_copy_client.cc:323] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:57:27.107523 28119 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet 9196b781b73d42de863558f5a560cce2 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:57:27.108047 28119 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet 9196b781b73d42de863558f5a560cce2 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-9196b781b73d42de863558f5a560cce2
I20260503 07:57:27.116587 28119 tablet_copy_source_session.cc:215] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:27.119804 28684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9196b781b73d42de863558f5a560cce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:27.137969 28691 ts_tablet_manager.cc:933] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:27.138882 28684 tablet_copy_client.cc:806] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:27.139421 28684 tablet_copy_client.cc:670] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:27.140146 28691 tablet_copy_client.cc:323] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.2:41375
I20260503 07:57:27.141561 28045 tablet_copy_service.cc:140] P adaf84b6ac60420ab03d39b9db9f0413: Received BeginTabletCopySession request for tablet 836271c3803e4270aeffc67aeb7df764 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:43620)
I20260503 07:57:27.141978 28045 tablet_copy_service.cc:161] P adaf84b6ac60420ab03d39b9db9f0413: Beginning new tablet copy session on tablet 836271c3803e4270aeffc67aeb7df764 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:43620: session id = 25017111886b42cfa5701a39de59b6ad-836271c3803e4270aeffc67aeb7df764
I20260503 07:57:27.143327 28684 tablet_copy_client.cc:538] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:27.147471 28045 tablet_copy_source_session.cc:215] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:27.150367 28691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 836271c3803e4270aeffc67aeb7df764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:27.151213 28684 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:27.167971 28691 tablet_copy_client.cc:806] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:27.168423 28691 tablet_copy_client.cc:670] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:27.177523 28691 tablet_copy_client.cc:538] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:27.183871 28691 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:27.185302 28684 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:27.185945 28684 tablet_bootstrap.cc:492] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:27.186477 28684 ts_tablet_manager.cc:1403] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.007s
I20260503 07:57:27.189644 28684 raft_consensus.cc:359] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.190253 28684 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:27.191450 28694 ts_tablet_manager.cc:933] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:27.191073 28684 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.195122 28684 ts_tablet_manager.cc:1434] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260503 07:57:27.196774 28119 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-9196b781b73d42de863558f5a560cce2 received from {username='slave'} at 127.0.0.1:59398
I20260503 07:57:27.197230 28119 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-9196b781b73d42de863558f5a560cce2 on tablet 9196b781b73d42de863558f5a560cce2 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:27.200438 28694 tablet_copy_client.cc:323] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:57:27.202211 28119 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet d9cb650978e344c697c44de57e4393e6 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:57:27.202690 28119 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet d9cb650978e344c697c44de57e4393e6 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-d9cb650978e344c697c44de57e4393e6
I20260503 07:57:27.211454 28119 tablet_copy_source_session.cc:215] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:27.211647 28691 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:27.212407 28691 tablet_bootstrap.cc:492] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:27.214393 28691 ts_tablet_manager.cc:1403] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.031s user 0.012s sys 0.014s
I20260503 07:57:27.217067 28694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cb650978e344c697c44de57e4393e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:27.217267 28691 raft_consensus.cc:359] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.218014 28691 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:27.218605 28691 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.226328 28691 ts_tablet_manager.cc:1434] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.012s user 0.000s sys 0.005s
I20260503 07:57:27.227892 28045 tablet_copy_service.cc:342] P adaf84b6ac60420ab03d39b9db9f0413: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-836271c3803e4270aeffc67aeb7df764 received from {username='slave'} at 127.0.0.1:43620
I20260503 07:57:27.228307 28045 tablet_copy_service.cc:434] P adaf84b6ac60420ab03d39b9db9f0413: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-836271c3803e4270aeffc67aeb7df764 on tablet 836271c3803e4270aeffc67aeb7df764 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:27.235253 28694 tablet_copy_client.cc:806] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:27.235775 28694 tablet_copy_client.cc:670] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:27.238857 28694 tablet_copy_client.cc:538] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:27.245424 28694 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:27.263554 28694 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:27.264192 28694 tablet_bootstrap.cc:492] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:27.264705 28694 ts_tablet_manager.cc:1403] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.004s
I20260503 07:57:27.267165 28694 raft_consensus.cc:359] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.267675 28694 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:27.268178 28694 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:27.270020 28694 ts_tablet_manager.cc:1434] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260503 07:57:27.271350 28119 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-d9cb650978e344c697c44de57e4393e6 received from {username='slave'} at 127.0.0.1:59398
I20260503 07:57:27.271701 28119 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-d9cb650978e344c697c44de57e4393e6 on tablet d9cb650978e344c697c44de57e4393e6 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:27.381832 28621 raft_consensus.cc:1217] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:27.508682 28621 raft_consensus.cc:1217] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:27.585176 28621 raft_consensus.cc:1217] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:27.601855 28621 raft_consensus.cc:1217] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:27.811524 28699 raft_consensus.cc:1064] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:27.814114 28699 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:27.821055 28109 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:27.821753 28621 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:27.821967 27954 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:27.823217 28671 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:27.824064 28269 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:27.829869 28699 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:27.840121 28269 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.844635 28109 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.854465 27954 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.858282 28621 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.863622 27856 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.900497 28035 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:27.905385 27954 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:27.905392 28621 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:27.906629 28699 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:27.907454 28704 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:27.916522 28671 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.917826 27955 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.924010 27844 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 28731014d42b4316af0150b0e98f6152 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:27.924271 28621 raft_consensus.cc:2955] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:27.931708 27854 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:27.968282 28098 tablet_service.cc:1558] Processing DeleteTablet for tablet 28731014d42b4316af0150b0e98f6152 with delete_type TABLET_DATA_TOMBSTONED (TS be26cebb7c90445ea9a74f66463457c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43212
I20260503 07:57:27.989821 28709 tablet_replica.cc:333] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: stopping tablet replica
I20260503 07:57:27.991420 28709 raft_consensus.cc:2243] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:27.992002 28709 raft_consensus.cc:2272] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:27.994899 28709 ts_tablet_manager.cc:1916] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:28.003676 28671 raft_consensus.cc:1064] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:28.006157 28671 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:28.007613 28709 ts_tablet_manager.cc:1929] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:28.008082 28709 log.cc:1199] T 28731014d42b4316af0150b0e98f6152 P be26cebb7c90445ea9a74f66463457c1: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/wals/28731014d42b4316af0150b0e98f6152
I20260503 07:57:28.009558 27842 catalog_manager.cc:5002] TS be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): tablet 28731014d42b4316af0150b0e98f6152 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:28.011782 28109 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.013638 28671 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:28.013918 28621 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.016610 27955 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.016877 28671 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:28.018250 28699 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:28.030958 28704 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.032531 27955 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.035270 28621 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.042456 28108 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.052166 27854 catalog_manager.cc:5671] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:28.077507 28029 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:28.079094 28659 raft_consensus.cc:1064] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:28.083658 28622 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:28.084986 28699 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:28.085918 28698 raft_consensus.cc:1064] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:28.087586 28109 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:28.091320 28671 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:28.081341 28659 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:28.088356 28698 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:28.096092 28671 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.097182 28620 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.101598 28621 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.102419 27955 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.102807 28657 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:28.104586 28477 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:28.109475 28109 raft_consensus.cc:2955] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.111135 27856 catalog_manager.cc:5671] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.113341 28029 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.124410 27955 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.126772 28698 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:28.128350 27844 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 836271c3803e4270aeffc67aeb7df764 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:28.128331 28657 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:28.130643 28029 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.131489 28621 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:28.137742 28657 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:28.140178 28477 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:28.148609 27943 tablet_service.cc:1558] Processing DeleteTablet for tablet 836271c3803e4270aeffc67aeb7df764 with delete_type TABLET_DATA_TOMBSTONED (TS 37e72845941344c9b0aaa7235a6f4473 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45162
I20260503 07:57:28.166879 28477 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.177968 27960 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.197504 28721 tablet_replica.cc:333] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: stopping tablet replica
I20260503 07:57:28.198518 28721 raft_consensus.cc:2243] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:28.205528 28721 raft_consensus.cc:2272] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:28.202028 27856 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.209379 28721 ts_tablet_manager.cc:1916] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:28.212688 28621 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.201004 28657 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.224256 28721 ts_tablet_manager.cc:1929] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:28.227555 28721 log.cc:1199] T 836271c3803e4270aeffc67aeb7df764 P 37e72845941344c9b0aaa7235a6f4473: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/wals/836271c3803e4270aeffc67aeb7df764
I20260503 07:57:28.229660 28109 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:28.238180 28035 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.258248 28621 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:28.258028 27856 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:28.258390 28620 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.260624 27955 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:28.240594 27960 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.265637 28657 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:28.271909 28106 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:28.285392 28725 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:28.289299 28620 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:28.291637 28724 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:28.292177 28725 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.294221 27960 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:28.297345 27842 catalog_manager.cc:5002] TS 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): tablet 836271c3803e4270aeffc67aeb7df764 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:28.302920 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 9196b781b73d42de863558f5a560cce2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:28.302789 28724 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:28.306883 28620 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.315995 27857 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:28.316476 27955 raft_consensus.cc:2955] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.322777 28477 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.327764 28620 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.329360 27960 raft_consensus.cc:2955] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.330952 28021 tablet_service.cc:1558] Processing DeleteTablet for tablet 9196b781b73d42de863558f5a560cce2 with delete_type TABLET_DATA_TOMBSTONED (TS adaf84b6ac60420ab03d39b9db9f0413 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33286
I20260503 07:57:28.332139 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet d9cb650978e344c697c44de57e4393e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:28.354544 28726 tablet_replica.cc:333] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: stopping tablet replica
I20260503 07:57:28.355631 28726 raft_consensus.cc:2243] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:28.356187 28726 pending_rounds.cc:70] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Trying to abort 1 pending ops.
I20260503 07:57:28.349926 27857 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:28.356549 28726 pending_rounds.cc:77] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7281848516964147200 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "9196b781b73d42de863558f5a560cce2" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } } }
I20260503 07:57:28.361173 28726 raft_consensus.cc:2917] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260503 07:57:28.361589 28726 raft_consensus.cc:2889] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260503 07:57:28.362030 28726 raft_consensus.cc:2272] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:28.364768 28726 ts_tablet_manager.cc:1916] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:28.368009 28021 tablet_service.cc:1558] Processing DeleteTablet for tablet d9cb650978e344c697c44de57e4393e6 with delete_type TABLET_DATA_TOMBSTONED (TS adaf84b6ac60420ab03d39b9db9f0413 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33286
I20260503 07:57:28.378674 28726 ts_tablet_manager.cc:1929] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:28.379112 28726 log.cc:1199] T 9196b781b73d42de863558f5a560cce2 P adaf84b6ac60420ab03d39b9db9f0413: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/wals/9196b781b73d42de863558f5a560cce2
I20260503 07:57:28.380698 28726 tablet_replica.cc:333] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: stopping tablet replica
I20260503 07:57:28.381639 28726 raft_consensus.cc:2243] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:28.381690 27844 catalog_manager.cc:5002] TS adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): tablet 9196b781b73d42de863558f5a560cce2 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:28.382391 28726 raft_consensus.cc:2272] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:28.388363 28726 ts_tablet_manager.cc:1916] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:28.398483 28726 ts_tablet_manager.cc:1929] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:28.398761 28726 log.cc:1199] T d9cb650978e344c697c44de57e4393e6 P adaf84b6ac60420ab03d39b9db9f0413: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/wals/d9cb650978e344c697c44de57e4393e6
I20260503 07:57:28.399775 27844 catalog_manager.cc:5002] TS adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): tablet d9cb650978e344c697c44de57e4393e6 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:29.414852 28108 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:29.420583 27955 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:29.420645 28035 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260503 07:57:29.421554 28073 consensus_peers.cc:597] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 426966c8fb5d49eea85d577d437e4252. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:29.422371 28728 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.423290 28725 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.431607 28725 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.432812 28029 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.448351 27857 catalog_manager.cc:5671] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.450441 27960 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.482452 27960 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:29.488862 28108 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:29.496025 28029 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:29.497154 28738 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.499543 28738 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.506579 28683 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.508132 28029 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
W20260503 07:57:29.514161 27924 consensus_peers.cc:597] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2b5d5b5c52e455ca768d69be2c3e744. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:29.514322 28108 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.525555 28029 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:29.527961 27855 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.532197 27960 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:29.533409 28417 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.537909 28108 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260503 07:57:29.539131 27999 consensus_peers.cc:597] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a813d887a574b1f8a8be222ff2c07ae. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:29.539789 28417 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.541267 28417 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.545276 27960 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.552982 27955 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:29.558432 27856 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:29.562685 28106 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:29.562685 28029 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260503 07:57:29.564186 27924 consensus_peers.cc:597] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f94961272bf04c3789c23577f7fec5eb. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:29.565913 28748 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.567014 28683 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:29.570068 28108 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.608286 28738 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.612686 28029 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.709157 27855 catalog_manager.cc:5671] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:29.721131 28105 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:29.839995 28752 ts_tablet_manager.cc:933] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:29.841853 28752 tablet_copy_client.cc:323] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:57:29.843262 28119 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet 426966c8fb5d49eea85d577d437e4252 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:57:29.843765 28119 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet 426966c8fb5d49eea85d577d437e4252 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-426966c8fb5d49eea85d577d437e4252
I20260503 07:57:29.849920 28119 tablet_copy_source_session.cc:215] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:29.852370 28752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 426966c8fb5d49eea85d577d437e4252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:29.865619 28752 tablet_copy_client.cc:806] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:29.866014 28752 tablet_copy_client.cc:670] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:29.869172 28752 tablet_copy_client.cc:538] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:29.874928 28752 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:29.898524 28752 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:29.899209 28752 tablet_bootstrap.cc:492] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:29.900147 28752 ts_tablet_manager.cc:1403] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.009s
I20260503 07:57:29.902292 28752 raft_consensus.cc:359] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:29.903187 28752 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:29.903764 28752 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:29.906369 28752 ts_tablet_manager.cc:1434] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260503 07:57:29.908198 28754 ts_tablet_manager.cc:933] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:29.909533 28119 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-426966c8fb5d49eea85d577d437e4252 received from {username='slave'} at 127.0.0.1:59398
I20260503 07:57:29.909932 28119 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-426966c8fb5d49eea85d577d437e4252 on tablet 426966c8fb5d49eea85d577d437e4252 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:29.919035 28754 tablet_copy_client.cc:323] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.1:34525
I20260503 07:57:29.938841 27970 tablet_copy_service.cc:140] P 37e72845941344c9b0aaa7235a6f4473: Received BeginTabletCopySession request for tablet c2b5d5b5c52e455ca768d69be2c3e744 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:41856)
I20260503 07:57:29.939421 27970 tablet_copy_service.cc:161] P 37e72845941344c9b0aaa7235a6f4473: Beginning new tablet copy session on tablet c2b5d5b5c52e455ca768d69be2c3e744 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:41856: session id = 25017111886b42cfa5701a39de59b6ad-c2b5d5b5c52e455ca768d69be2c3e744
I20260503 07:57:29.946378 27970 tablet_copy_source_session.cc:215] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:29.948885 28754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2b5d5b5c52e455ca768d69be2c3e744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:29.960347 28754 tablet_copy_client.cc:806] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:29.960826 28754 tablet_copy_client.cc:670] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:29.964947 28754 tablet_copy_client.cc:538] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:29.971940 28754 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:29.996546 28754 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:29.998188 28754 tablet_bootstrap.cc:492] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:29.998749 28754 ts_tablet_manager.cc:1403] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.015s
I20260503 07:57:30.001102 28754 raft_consensus.cc:359] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:30.001653 28754 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:30.002125 28754 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:30.003789 28754 ts_tablet_manager.cc:1434] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260503 07:57:30.006837 27970 tablet_copy_service.cc:342] P 37e72845941344c9b0aaa7235a6f4473: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-c2b5d5b5c52e455ca768d69be2c3e744 received from {username='slave'} at 127.0.0.1:41856
I20260503 07:57:30.007464 27970 tablet_copy_service.cc:434] P 37e72845941344c9b0aaa7235a6f4473: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-c2b5d5b5c52e455ca768d69be2c3e744 on tablet c2b5d5b5c52e455ca768d69be2c3e744 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:30.028733 28754 ts_tablet_manager.cc:933] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:30.030403 28754 tablet_copy_client.cc:323] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.1:34525
I20260503 07:57:30.032101 27970 tablet_copy_service.cc:140] P 37e72845941344c9b0aaa7235a6f4473: Received BeginTabletCopySession request for tablet f94961272bf04c3789c23577f7fec5eb from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:41856)
I20260503 07:57:30.032786 27970 tablet_copy_service.cc:161] P 37e72845941344c9b0aaa7235a6f4473: Beginning new tablet copy session on tablet f94961272bf04c3789c23577f7fec5eb from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:41856: session id = 25017111886b42cfa5701a39de59b6ad-f94961272bf04c3789c23577f7fec5eb
I20260503 07:57:30.039402 28752 ts_tablet_manager.cc:933] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:30.040938 28752 tablet_copy_client.cc:323] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.2:41375
I20260503 07:57:30.041844 27970 tablet_copy_source_session.cc:215] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:30.042567 28045 tablet_copy_service.cc:140] P adaf84b6ac60420ab03d39b9db9f0413: Received BeginTabletCopySession request for tablet 8a813d887a574b1f8a8be222ff2c07ae from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:43620)
I20260503 07:57:30.043016 28045 tablet_copy_service.cc:161] P adaf84b6ac60420ab03d39b9db9f0413: Beginning new tablet copy session on tablet 8a813d887a574b1f8a8be222ff2c07ae from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:43620: session id = 25017111886b42cfa5701a39de59b6ad-8a813d887a574b1f8a8be222ff2c07ae
I20260503 07:57:30.044582 28754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94961272bf04c3789c23577f7fec5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:30.050377 28045 tablet_copy_source_session.cc:215] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:30.054838 28752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a813d887a574b1f8a8be222ff2c07ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:30.058950 28754 tablet_copy_client.cc:806] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:30.059435 28754 tablet_copy_client.cc:670] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:30.067507 28752 tablet_copy_client.cc:806] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:30.068004 28752 tablet_copy_client.cc:670] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:30.068302 28754 tablet_copy_client.cc:538] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:30.072568 28752 tablet_copy_client.cc:538] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:30.076148 28754 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:30.081540 28752 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:30.104866 28754 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:30.105809 28754 tablet_bootstrap.cc:492] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:30.106412 28754 ts_tablet_manager.cc:1403] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.030s user 0.020s sys 0.007s
I20260503 07:57:30.109217 28754 raft_consensus.cc:359] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:30.109927 28754 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:30.110492 28754 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:30.111382 28752 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:30.112095 28752 tablet_bootstrap.cc:492] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:30.113885 28752 ts_tablet_manager.cc:1403] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.033s user 0.015s sys 0.011s
I20260503 07:57:30.116396 28752 raft_consensus.cc:359] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:30.117162 28752 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:30.117722 28752 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:30.119597 28752 ts_tablet_manager.cc:1434] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260503 07:57:30.120929 28045 tablet_copy_service.cc:342] P adaf84b6ac60420ab03d39b9db9f0413: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-8a813d887a574b1f8a8be222ff2c07ae received from {username='slave'} at 127.0.0.1:43620
I20260503 07:57:30.121289 28045 tablet_copy_service.cc:434] P adaf84b6ac60420ab03d39b9db9f0413: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-8a813d887a574b1f8a8be222ff2c07ae on tablet 8a813d887a574b1f8a8be222ff2c07ae with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:30.126443 28754 ts_tablet_manager.cc:1434] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260503 07:57:30.128521 27970 tablet_copy_service.cc:342] P 37e72845941344c9b0aaa7235a6f4473: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-f94961272bf04c3789c23577f7fec5eb received from {username='slave'} at 127.0.0.1:41856
I20260503 07:57:30.128876 27970 tablet_copy_service.cc:434] P 37e72845941344c9b0aaa7235a6f4473: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-f94961272bf04c3789c23577f7fec5eb on tablet f94961272bf04c3789c23577f7fec5eb with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:30.226727 28620 raft_consensus.cc:1217] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:30.362715 28620 raft_consensus.cc:1217] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:30.490748 28620 raft_consensus.cc:1217] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:30.644061 28620 raft_consensus.cc:1217] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:30.763940 28728 raft_consensus.cc:1064] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:30.766268 28728 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:30.773216 28766 raft_consensus.cc:1064] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:30.775578 28766 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:30.779084 28620 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:30.781355 28725 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:30.783387 28029 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:30.785486 28105 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:30.785840 27960 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:30.786655 28029 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:30.786917 28620 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:30.787976 28769 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:30.788308 28748 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:30.789003 28728 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:30.789992 28748 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:30.792451 28764 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:30.799427 28751 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.800380 27960 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.814841 28621 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.827756 27856 catalog_manager.cc:5671] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:30.853408 28764 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.856736 28620 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.866665 28108 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.867390 28029 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.867681 28035 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.891937 27854 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.918414 28108 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:30.922072 28620 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:30.922933 28035 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:30.923264 28769 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:30.923383 27956 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:30.925653 28725 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:30.927824 28035 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:30.928872 28764 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:30.931170 28621 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:30.931912 28728 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.934892 28748 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.936169 28029 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.941701 28035 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.942993 28766 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:30.945326 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 426966c8fb5d49eea85d577d437e4252 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:30.947789 28621 raft_consensus.cc:2955] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.949908 27854 catalog_manager.cc:5671] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:30.957731 28620 raft_consensus.cc:2955] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.973117 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet c2b5d5b5c52e455ca768d69be2c3e744 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:30.979075 27943 tablet_service.cc:1558] Processing DeleteTablet for tablet 426966c8fb5d49eea85d577d437e4252 with delete_type TABLET_DATA_TOMBSTONED (TS 37e72845941344c9b0aaa7235a6f4473 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45162
I20260503 07:57:30.981388 28780 tablet_replica.cc:333] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: stopping tablet replica
I20260503 07:57:30.982317 28780 raft_consensus.cc:2243] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:30.982872 28780 raft_consensus.cc:2272] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:30.983134 27854 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:30.992380 28780 ts_tablet_manager.cc:1916] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:31.000629 28765 raft_consensus.cc:1064] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:31.004969 28098 tablet_service.cc:1558] Processing DeleteTablet for tablet c2b5d5b5c52e455ca768d69be2c3e744 with delete_type TABLET_DATA_TOMBSTONED (TS be26cebb7c90445ea9a74f66463457c1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43212
I20260503 07:57:31.010499 28780 ts_tablet_manager.cc:1929] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:31.010938 28780 log.cc:1199] T 426966c8fb5d49eea85d577d437e4252 P 37e72845941344c9b0aaa7235a6f4473: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/wals/426966c8fb5d49eea85d577d437e4252
I20260503 07:57:31.014673 28765 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:31.019366 27842 catalog_manager.cc:5002] TS 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): tablet 426966c8fb5d49eea85d577d437e4252 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:31.032323 28782 tablet_replica.cc:333] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: stopping tablet replica
I20260503 07:57:31.033000 28782 raft_consensus.cc:2243] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:31.033738 28782 raft_consensus.cc:2272] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:31.037282 28782 ts_tablet_manager.cc:1916] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:31.039515 28105 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:31.040108 27955 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:31.041158 28620 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:31.048151 28784 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:31.050788 28782 ts_tablet_manager.cc:1929] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:31.050588 28781 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:31.051172 28782 log.cc:1199] T c2b5d5b5c52e455ca768d69be2c3e744 P be26cebb7c90445ea9a74f66463457c1: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/wals/c2b5d5b5c52e455ca768d69be2c3e744
I20260503 07:57:31.051674 28784 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:31.052663 27842 catalog_manager.cc:5002] TS be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): tablet c2b5d5b5c52e455ca768d69be2c3e744 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:31.089411 28784 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.094621 28108 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.097764 28620 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.101629 27960 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.111178 27855 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.129176 28031 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:31.133517 28105 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:31.135018 28765 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:31.135217 28620 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:31.137696 28765 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:31.142398 28765 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.147985 28105 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.151088 28620 raft_consensus.cc:2955] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.158766 27844 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 8a813d887a574b1f8a8be222ff2c07ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:31.165849 27856 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.181540 27943 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a813d887a574b1f8a8be222ff2c07ae with delete_type TABLET_DATA_TOMBSTONED (TS 37e72845941344c9b0aaa7235a6f4473 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45162
I20260503 07:57:31.182403 28780 tablet_replica.cc:333] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: stopping tablet replica
I20260503 07:57:31.183369 28780 raft_consensus.cc:2243] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:31.183933 28780 raft_consensus.cc:2272] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:31.185618 28748 raft_consensus.cc:1064] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:31.187232 28780 ts_tablet_manager.cc:1916] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:31.187592 28748 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:31.196179 28105 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:31.197878 28766 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:31.200065 28780 ts_tablet_manager.cc:1929] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:31.200413 28780 log.cc:1199] T 8a813d887a574b1f8a8be222ff2c07ae P 37e72845941344c9b0aaa7235a6f4473: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/wals/8a813d887a574b1f8a8be222ff2c07ae
I20260503 07:57:31.202080 27842 catalog_manager.cc:5002] TS 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): tablet 8a813d887a574b1f8a8be222ff2c07ae (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:31.204909 28031 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:31.205852 28620 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:31.209985 28748 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:31.211335 28766 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:31.219640 28764 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.220963 28031 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.223832 28620 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.233461 28105 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.234690 27855 catalog_manager.cc:5671] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.257004 27960 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:31.261430 28105 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:31.262347 28620 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:31.262770 28764 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:31.263578 28748 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:31.270219 28766 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.274581 28105 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.276057 28620 raft_consensus.cc:2955] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:31.278824 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet f94961272bf04c3789c23577f7fec5eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:31.287175 27854 catalog_manager.cc:5671] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New cstate: current_term: 1 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:31.296517 28021 tablet_service.cc:1558] Processing DeleteTablet for tablet f94961272bf04c3789c23577f7fec5eb with delete_type TABLET_DATA_TOMBSTONED (TS adaf84b6ac60420ab03d39b9db9f0413 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33286
I20260503 07:57:31.299103 28793 tablet_replica.cc:333] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: stopping tablet replica
I20260503 07:57:31.299788 28793 raft_consensus.cc:2243] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:31.300441 28793 raft_consensus.cc:2272] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:31.306386 28793 ts_tablet_manager.cc:1916] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:31.315706 28793 ts_tablet_manager.cc:1929] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:31.316012 28793 log.cc:1199] T f94961272bf04c3789c23577f7fec5eb P adaf84b6ac60420ab03d39b9db9f0413: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/wals/f94961272bf04c3789c23577f7fec5eb
I20260503 07:57:31.317250 27844 catalog_manager.cc:5002] TS adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): tablet f94961272bf04c3789c23577f7fec5eb (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:32.364667 28031 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:32.370198 28105 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:32.372270 27956 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:32.372032 28795 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260503 07:57:32.373035 27999 consensus_peers.cc:597] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4029065128b84be9a45c0bfe2af75b6f. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:32.373936 28765 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:32.380257 28784 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.382938 27955 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.381769 28105 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.395246 28029 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:32.412607 27857 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
W20260503 07:57:32.429839 27999 consensus_peers.cc:597] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d2e3ed8ebbe4d968d5ab9e678ea1561. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:32.431229 28105 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:32.434654 28795 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:32.439729 27955 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:32.440824 28795 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:32.447238 28800 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.454905 28108 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.460439 28106 consensus_queue.cc:237] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:32.468910 27855 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:32.482290 27955 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
W20260503 07:57:32.483919 28073 consensus_peers.cc:597] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4a767f631d84b75af79d3964f3a548f. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:32.485314 28031 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:32.487432 27956 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:32.487560 28806 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:32.488649 28794 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:32.509682 28728 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.514747 27956 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.520236 28106 consensus_queue.cc:237] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
W20260503 07:57:32.528211 28073 consensus_peers.cc:597] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9d2b513dd664ccfbfcbd9f74fe0dddf. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:32.528985 27956 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:32.529167 27857 catalog_manager.cc:5671] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.530268 28806 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:32.531939 28029 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:32.535099 28728 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:32.540282 28031 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.552493 28794 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.554399 27955 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.559376 28029 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:32.573952 27857 catalog_manager.cc:5671] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:33.599320 28815 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:33.599992 28815 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:33.602944 28815 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:33.603461 28815 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:33.603953 28815 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:33.783690 28815 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:33.786403 28815 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:33.788168 28815 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:33.796242 28815 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:33.972771 28816 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.064219 28816 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.066749 28816 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:34.101697 28815 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.102352 28815 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.104660 28815 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.105213 28815 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.317085 28815 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.319710 28815 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.140753 28817 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.330930 28817 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.333092 28817 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.213986 28816 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.333825 28816 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:34.335861 28816 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.336670 28818 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.337155 28818 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.338919 28818 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.339406 28818 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.339833 28818 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.341532 28818 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.347114 28819 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.347770 28819 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.349972 28818 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.350538 28818 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.352432 28818 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.364670 28818 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.366705 28818 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.366140 28816 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.368966 28816 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:34.369530 28817 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.370276 28817 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:34.370981 28816 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.373229 28818 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.376981 28815 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.377611 28815 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.379843 28815 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.384793 28827 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.385320 28827 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.388070 28827 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.372954 28817 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.396152 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 170) took 1824 ms. Trace:
I20260503 07:57:34.398116 28827 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.398648 28831 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.398609 28827 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.399036 28820 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.399273 28831 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.400735 28827 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.401214 28827 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.409516 28827 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.415212 28827 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.416538 28827 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.417763 28815 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.418560 28815 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.417760 28827 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.423750 28827 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.396600 27857 rpcz_store.cc:276] 0503 07:57:32.571475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:32.571608 (+ 133us) service_pool.cc:224] Handling call
0503 07:57:34.396064 (+1824456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:57:32.576155 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:57:32.576628 (+ 473us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:57:32.576656 (+ 28us) write_op.cc:435] Acquired schema lock
0503 07:57:32.576667 (+ 11us) tablet.cc:662] Decoding operations
0503 07:57:32.576934 (+ 267us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:57:32.576982 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0503 07:57:32.577005 (+ 23us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:57:32.577192 (+ 187us) tablet.cc:701] Row locks acquired
0503 07:57:32.577203 (+ 11us) write_op.cc:260] PREPARE: finished
0503 07:57:32.577349 (+ 146us) write_op.cc:270] Start()
0503 07:57:32.577436 (+ 87us) write_op.cc:276] Timestamp: P: 1777795052577301 usec, L: 0
0503 07:57:32.577451 (+ 15us) op_driver.cc:348] REPLICATION: starting
0503 07:57:32.577941 (+ 490us) log.cc:844] Serialized 590 byte log entry
0503 07:57:32.579421 (+ 1480us) op_driver.cc:464] REPLICATION: finished
0503 07:57:32.584588 (+ 5167us) write_op.cc:301] APPLY: starting
0503 07:57:32.584654 (+ 66us) tablet.cc:1367] starting BulkCheckPresence
0503 07:57:32.584747 (+ 93us) tablet.cc:1370] finished BulkCheckPresence
0503 07:57:32.584833 (+ 86us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:57:32.584991 (+ 158us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:57:32.585150 (+ 159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:57:32.585194 (+ 44us) write_op.cc:312] APPLY: finished
0503 07:57:32.585336 (+ 142us) log.cc:844] Serialized 22 byte log entry
0503 07:57:32.585465 (+ 129us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:32.585531 (+ 66us) write_op.cc:454] Released schema lock
0503 07:57:32.585562 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0503 07:57:32.585805 (+ 243us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:32.585829 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":5015,"apply.run_cpu_time_us":1191,"apply.run_wall_time_us":1191,"num_ops":1,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2029,"prepare.run_wall_time_us":2029,"replication_time_us":1864}]]}
I20260503 07:57:34.420814 28815 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.428905 28817 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.430075 28818 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.399577 28820 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.486887 28820 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.487025 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33434 (request call id 175) took 1902 ms. Trace:
I20260503 07:57:34.487459 27855 rpcz_store.cc:276] 0503 07:57:32.584170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:32.584309 (+ 139us) service_pool.cc:224] Handling call
0503 07:57:34.486924 (+1902615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1893722,"reported_tablets":1}
I20260503 07:57:34.489358 28818 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.490417 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 188) took 1906 ms. Trace:
I20260503 07:57:34.490859 27854 rpcz_store.cc:276] 0503 07:57:32.584177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:32.584324 (+ 147us) service_pool.cc:224] Handling call
0503 07:57:34.490330 (+1906006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1851718,"reported_tablets":1,"spinlock_wait_cycles":12672}
I20260503 07:57:34.491694 28820 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.492332 28820 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:34.494779 28820 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.352241 28819 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.470340 28827 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.497256 28818 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.471659 28833 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.469098 28823 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.498845 28824 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.469950 28834 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.499442 28817 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.499574 28834 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.502004 28834 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.479177 28828 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.502347 28817 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.502781 28828 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.505257 28828 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.481073 28816 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.509817 28816 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.512339 28816 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.474856 28835 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.497027 28827 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.513032 28835 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.513082 28824 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.514124 28827 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.514590 28827 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.514855 28835 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.514957 28827 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.516142 28824 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.497817 28833 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.518610 28833 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.477025 28831 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.516794 28827 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.498592 28823 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.521479 28823 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.521565 28833 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.521853 28832 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.522114 28833 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.469340 28826 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.522603 28832 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.522971 28826 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.523850 28818 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.524044 28833 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.522434 28835 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.471447 28821 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.524327 28818 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.526721 28833 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.529466 28838 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.528445 28819 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.526648 28818 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.529978 28820 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.524530 28832 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.529771 28815 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.524871 28826 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.554235 28848 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.525120 28835 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.568465 28824 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.536058 28822 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.527488 28831 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.525164 28827 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.553920 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:34.548450 28855 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.553236 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:34.569303 28823 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.525007 28828 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.552093 28847 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.547691 28816 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.554365 28844 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.573901 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:34.541064 28817 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.695026 28620 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:34.695297 28817 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.695423 28816 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.525346 28821 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.526983 28836 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.533491 28837 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.538702 28845 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.535408 28842 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.572145 28851 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.545060 28846 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.574602 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:34.553575 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:34.709569 28029 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:57:34.545930 28834 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.694006 28828 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.538771 28843 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.543751 28839 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.609438 28833 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.715634 28825 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.715412 28834 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.571807 28856 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.687515 28826 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.676061 28820 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.669507 28819 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.546880 28854 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.694273 28823 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.668991 28818 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.681564 28815 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.545866 28840 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.539620 28830 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.575700 28850 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.716075 28825 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.723969 27924 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:34.685971 28838 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.691461 28831 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.701957 28841 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.745081 28866 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.696926 28822 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.691840 28824 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:34.693665 28827 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.713541 28621 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:34.723052 28856 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:34.716739 28837 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.715551 28859 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.698335 28848 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.713562 28836 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.709867 28855 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.705412 28844 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.752570 28838 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.711539 28845 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.737421 28853 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.742539 28865 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.735742 28826 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.773921 28867 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.774251 28815 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.744351 28834 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.735324 28860 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.735841 28839 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.716454 28846 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.739830 28818 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.708395 28847 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.743350 28854 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.756129 28816 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.745445 28841 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.778529 28817 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.778177 28838 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.784938 28835 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.745702 28866 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.787825 28831 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.791582 28820 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.787433 28815 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:34.716862 28851 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.723878 28842 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.795506 28834 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.806680 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:34.734689 28843 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:34.797413 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 73535us
I20260503 07:57:34.809448 27955 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:57:34.812413 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:34.798954 28821 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.799441 28832 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.799000 28833 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.798871 28816 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.753893 28840 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.781960 28859 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.806732 28817 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.806058 28815 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.814234 28828 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.788872 28867 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.791538 28853 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.831521 28821 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.830365 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:34.817443 28858 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:34.756300 28830 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.798738 28838 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:34.818897 28835 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:34.817541 28861 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.757089 28850 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:34.799415 28585 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:34.825716 28819 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.811295 28834 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.829623 28823 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.829311 28848 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.823874 28832 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.793443 28860 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:34.828001 28816 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.790035 28865 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.835035 28815 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:34.882947 28831 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.013696 28827 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.839519 28863 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:35.014796 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.008942 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:34.937366 28820 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.849294 28821 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.095974 28823 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:34.896188 28866 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.094601 28834 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.833796 28817 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.149610 28847 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.840111 28833 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.151292 28832 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.151713 28853 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.151386 28833 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.912462 28852 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.149514 28859 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.149288 28823 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:34.849603 28824 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.912322 28843 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.896004 28822 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:34.926715 28826 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.896415 28837 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.939707 28818 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.014273 28839 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.933276 28862 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:34.996675 28836 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.912149 28846 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.153869 28847 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.179597 28867 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.937870 28845 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:34.912310 28849 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.141294 28835 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.178046 28851 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.100765 28855 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.928673 28844 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.187247 28854 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.166054 28842 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.166813 28823 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.144058 28819 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.015782 28825 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.166939 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:35.169703 28833 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.178157 28830 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.170149 28841 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.173167 28815 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.014114 28831 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.143594 28840 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:34.912611 28864 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.184463 28847 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.090844 28820 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.186602 28835 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.178202 28838 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.093351 28863 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.169770 28817 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.205241 28860 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:57:35.205910 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 469476us
I20260503 07:57:35.192360 28830 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.198083 28833 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.206542 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:35.206605 28833 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.207204 28620 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:35.191154 28819 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.198617 28871 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.198573 28856 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:35.191409 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 100552us
I20260503 07:57:35.202870 27955 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:35.014086 28861 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.203665 28836 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.206015 28827 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.183779 28816 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.097143 28858 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.218917 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.173985 28852 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.191618 28862 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.211400 27924 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:35.206477 28830 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.215458 28839 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.220371 28819 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.213025 28822 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.221132 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.220794 28863 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.223855 28833 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.217476 28836 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.225566 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:35.209872 28871 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.216495 28827 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:35.237597 28621 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.237710 28827 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.226804 28831 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.216596 28856 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.229712 28830 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.228204 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.230628 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.231127 28108 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.241513 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.231254 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.242030 27954 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.242116 27955 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.234310 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.229872 28816 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.234604 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.241379 27956 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.215797 28820 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.227387 28821 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:35.228201 28815 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:35.228390 28847 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.245193 28856 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.245941 28816 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:35.248471 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.249006 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.249657 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.232573 28825 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.250258 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.251372 28029 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:57:35.251418 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.249958 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.252012 28825 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.252610 28823 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:35.253077 28823 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.237651 28874 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:35.253886 27955 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.191787 28849 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.254393 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.254946 28825 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.239694 28836 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.257172 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.257270 27954 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.254160 28816 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.230743 28839 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:35.235853 28822 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.262475 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.262920 27954 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.245909 28850 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.262936 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.264667 28108 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.265120 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.258564 28861 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:35.267186 28841 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.281137 28841 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.285828 28823 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.271592 28825 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:35.286917 28841 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.286826 28825 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.265273 28821 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.300707 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.263581 28585 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:35.302486 28862 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.281306 28858 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.288878 28825 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.307582 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.297278 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.267004 28865 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.211988 28864 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:35.258363 28874 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.336772 28874 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:35.361795 28643 debug-util.cc:398] Leaking SignalData structure 0x7b080030a180 after lost signal to thread 26795
I20260503 07:57:35.332253 28839 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:35.304966 28871 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.378935 28852 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.379604 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:35.309320 28821 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.385895 28835 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.389482 28878 ts_tablet_manager.cc:933] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:35.401249 28643 debug-util.cc:398] Leaking SignalData structure 0x7b080030a860 after lost signal to thread 27891
I20260503 07:57:35.412774 27955 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:35.386806 28856 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.395449 28822 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.416754 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:35.417943 28864 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.419716 28835 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:35.422144 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.422801 28109 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.427515 28880 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.412437 28821 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.428992 28880 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.431150 28880 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.431900 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.432430 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:35.413082 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 153401us
I20260503 07:57:35.436084 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.436455 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:35.431934 28643 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7be0 after lost signal to thread 27984
I20260503 07:57:35.435029 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.438273 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.438750 28035 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.441438 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.442669 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:35.443174 28643 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1b40 after lost signal to thread 28059
I20260503 07:57:35.442708 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:35.445423 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.446244 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.446435 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.449395 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.450913 28881 ts_tablet_manager.cc:933] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.455225 27960 raft_consensus.cc:1240] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:35.439232 28816 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.457394 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.451129 28849 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:35.459033 28643 debug-util.cc:398] Leaking SignalData structure 0x7b0800287080 after lost signal to thread 28133
I20260503 07:57:35.461472 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.462291 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.462914 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.452674 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.459642 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.469967 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.470945 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.469663 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:35.460584 28643 debug-util.cc:398] Leaking SignalData structure 0x7b08002c18a0 after lost signal to thread 28647
I20260503 07:57:35.447104 28585 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:35.468662 28621 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:35.469460 28816 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:35.478417 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.481364 28616 raft_consensus.cc:1240] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:35.483098 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.483237 27924 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:35.484103 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.484475 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.483639 28107 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:35.485339 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.485831 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.487272 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.442451 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:35.464689 28827 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.496486 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.497383 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.496948 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.496784 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.499282 27959 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.500141 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.500840 28029 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.489257 28816 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:35.502125 28816 raft_consensus.cc:697] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:35.503175 28816 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.503571 28827 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.504227 28827 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.468197 28830 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.506717 28617 raft_consensus.cc:1240] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:35.508812 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.509379 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.510259 28618 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:35.511320 28830 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.514170 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.516381 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.516662 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:35.517666 27951 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:35.518980 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.519292 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.520915 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.521438 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.522291 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.545735 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.546310 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.546613 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.548811 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.548842 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.549331 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.549840 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.550340 27954 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:35.550626 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.550947 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.551082 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.546942 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.550374 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.553329 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.555032 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.550300 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.557864 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.558616 28029 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.493214 28880 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.494302 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:35.563253 28879 ts_tablet_manager.cc:933] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:35.572630 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.573185 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.573694 28035 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.586501 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.592963 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.595281 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.595692 28880 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.594327 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.620862 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.621963 28878 tablet_copy_client.cc:323] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.2:41375
I20260503 07:57:35.637204 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.629295 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.634944 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.635401 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.635553 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.643844 28031 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.636241 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.640784 28029 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.638804 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.650104 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.653579 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.653410 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.639338 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.654696 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.655731 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.655993 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.656893 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:35.658593 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.661321 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.665524 28619 raft_consensus.cc:1240] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:35.666013 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.663093 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.663012 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.667025 28835 consensus_queue.cc:1059] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260503 07:57:35.681485 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.682472 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.685927 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.686005 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.686652 28030 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.687175 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.687510 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.688076 28032 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.688301 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.688915 28034 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.689298 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.689534 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.689828 28031 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:35.690145 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.690646 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.691952 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.692924 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.693385 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.693542 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.694054 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.692711 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.694650 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.695436 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.695763 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.684194 28835 raft_consensus.cc:3055] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:35.696401 28835 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:35.696870 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.697165 28835 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.698348 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.698753 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.699955 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.701637 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.688867 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.698274 28835 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.703853 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.705691 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.706792 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.707402 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.707871 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.708490 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.709582 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.709954 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.710052 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.711115 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:35.711232 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.712116 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.712183 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.713824 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.715503 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.716120 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:35.717307 27926 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.631s (SENT)
I20260503 07:57:35.715760 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.721990 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.723603 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.725334 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.726929 28881 tablet_copy_client.cc:323] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.2:41375
I20260503 07:57:35.728073 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.729954 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:35.729446 28883 ts_tablet_manager.cc:933] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:35.739228 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:35.739704 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 298087us
I20260503 07:57:35.739878 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:35.739989 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.740625 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.740787 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.743523 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.749269 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.753360 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:35.753595 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.747877 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.755704 28045 tablet_copy_service.cc:140] P adaf84b6ac60420ab03d39b9db9f0413: Received BeginTabletCopySession request for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:43620)
I20260503 07:57:35.756121 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:35.756243 28045 tablet_copy_service.cc:161] P adaf84b6ac60420ab03d39b9db9f0413: Beginning new tablet copy session on tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:43620: session id = 25017111886b42cfa5701a39de59b6ad-3d2e3ed8ebbe4d968d5ab9e678ea1561
I20260503 07:57:35.757918 27854 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:35.749204 28879 tablet_copy_client.cc:323] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:57:35.764391 28856 consensus_queue.cc:1059] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260503 07:57:35.765877 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.765419 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.763592 28044 tablet_copy_service.cc:140] P adaf84b6ac60420ab03d39b9db9f0413: Received BeginTabletCopySession request for tablet 4029065128b84be9a45c0bfe2af75b6f from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:43620)
I20260503 07:57:35.761317 28583 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.765205 28585 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:35.778239 28821 consensus_queue.cc:1059] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260503 07:57:35.786702 28880 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.782402 28044 tablet_copy_service.cc:161] P adaf84b6ac60420ab03d39b9db9f0413: Beginning new tablet copy session on tablet 4029065128b84be9a45c0bfe2af75b6f from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:43620: session id = 25017111886b42cfa5701a39de59b6ad-4029065128b84be9a45c0bfe2af75b6f
I20260503 07:57:35.788475 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.794274 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.787411 28885 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.805291 28840 raft_consensus.cc:3055] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:35.805644 28840 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:35.806427 28840 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.807650 28840 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.804397 28825 raft_consensus.cc:3055] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:35.810556 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.812376 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.811615 28825 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:57:35.818143 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 44215.2us
I20260503 07:57:35.818985 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.820065 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.820957 28883 tablet_copy_client.cc:323] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:57:35.821013 28825 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.821770 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.822263 28825 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.822430 28865 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.817224 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.824996 28045 tablet_copy_source_session.cc:215] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:35.824951 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:35.828006 28821 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.828353 28821 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:35.828683 28821 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.829037 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.819761 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.830603 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.830839 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:35.833118 28885 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.834708 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.836007 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.836018 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.837344 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.838551 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.838976 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.833422 28583 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.840372 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.840634 28583 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.841307 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.842363 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.843509 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.843979 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.845345 28880 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.845675 28885 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.846838 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.847905 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.848063 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.849800 28821 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.851915 28821 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:35.861694 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.862656 28073 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:35.863226 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.863703 28840 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:35.864163 28840 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:35.864467 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.864574 28840 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:35.866019 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:35.869324 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:35.869319 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.871749 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.872841 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.874859 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:35.876296 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.876904 28861 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.877282 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.877592 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.878114 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.878985 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.880414 28075 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:35.877142 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.881392 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.881515 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.881636 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.882431 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.882663 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.883203 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.886078 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.887703 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.887902 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.888742 28874 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.887296 27926 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.889153 28874 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.889542 28874 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.891844 27926 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.877424 28878 tablet_copy_client.cc:806] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:35.892678 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.892935 28075 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:35.893610 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:35.893193 27926 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.913987 27926 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.914979 27926 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.915158 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.915678 28818 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.915970 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.916236 28818 raft_consensus.cc:2749] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.916762 28850 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.898387 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.886318 28044 tablet_copy_source_session.cc:215] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:35.916019 27926 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.919346 27926 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.920086 27926 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.898720 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:35.920997 28850 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.921227 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.921701 28119 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:57:35.922257 28119 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet c9d2b513dd664ccfbfcbd9f74fe0dddf from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-c9d2b513dd664ccfbfcbd9f74fe0dddf
I20260503 07:57:35.922669 28885 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.922708 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.923779 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:35.925053 28885 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.918606 28861 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.921747 28816 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.898036 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.898177 28835 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:35.942009 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 49133.9us
I20260503 07:57:35.956112 28075 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:35.957974 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:35.959372 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:35.961611 28891 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.962260 28861 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.963027 28863 raft_consensus.cc:2749] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.937379 28878 tablet_copy_client.cc:670] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:35.941280 28892 consensus_queue.cc:1059] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260503 07:57:35.942005 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.965807 28892 raft_consensus.cc:3055] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:35.966190 28892 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:35.966929 28892 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:35.968152 28881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4029065128b84be9a45c0bfe2af75b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:35.956300 28841 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.907311 28865 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.969161 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:35.964478 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:35.933033 28818 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.970952 28119 tablet_copy_source_session.cc:215] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:35.938298 28118 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet d4a767f631d84b75af79d3964f3a548f from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:57:35.970261 28841 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.979066 28841 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.942543 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:35.976778 28118 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet d4a767f631d84b75af79d3964f3a548f from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-d4a767f631d84b75af79d3964f3a548f
I20260503 07:57:35.977166 28878 tablet_copy_client.cc:538] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:35.977777 28894 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.978745 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260503 07:57:35.980149 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 60100us
I20260503 07:57:35.981158 28856 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.983681 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:35.983949 28075 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:35.986670 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.987455 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.968508 28892 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.988690 27926 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.985085 28894 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.989557 28865 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.970593 28874 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:35.990108 28894 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.992033 28835 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.990232 28856 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.988039 28849 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:35.993117 28856 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.993181 28849 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:35.989488 28818 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:35.991397 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:35.995080 28856 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.994035 28849 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:35.993882 27926 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:35.998705 28101 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.001405 28840 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.006631 28835 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.007532 28863 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.008159 28863 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.008625 28863 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.012753 27926 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.012848 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:36.014591 28075 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:36.015309 28075 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:36.016402 28823 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.016790 28823 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.016917 28864 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.017091 28818 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.017342 28864 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.017807 28864 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.016284 28816 consensus_queue.cc:1059] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260503 07:57:36.018707 28874 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.019400 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.017186 28823 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.025113 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.025472 28075 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.021061 28821 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.026062 28891 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.026213 28821 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.026659 28821 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.026604 28841 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.027606 28075 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.028260 28891 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.028539 28841 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.029258 28075 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.030646 28075 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.030552 28891 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.030683 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.031749 28075 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.032011 28865 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.032348 28865 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.031302 28841 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.032473 28891 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.033262 28075 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.034014 28841 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.035074 28075 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:36.036274 28823 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.036859 28118 tablet_copy_source_session.cc:215] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:36.037837 28841 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.038034 28823 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.038292 28841 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.039131 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.039981 28075 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.040496 28883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a767f631d84b75af79d3964f3a548f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:36.039552 28841 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.041561 28075 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:36.043329 28823 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.043699 28075 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:36.047590 28823 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.047923 28101 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:36.047983 28823 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.047940 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:36.048724 28823 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.049050 28891 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.049454 28891 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.049497 28816 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:36.049866 28891 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.057492 28075 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.061968 28861 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.050894 28856 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.064874 28856 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.052960 28899 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.066072 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.068819 28823 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.070497 28823 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.071439 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.058943 28840 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.080034 28891 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:36.081490 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 68709us
I20260503 07:57:36.033157 28865 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.077508 28821 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.084422 28821 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.084476 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:36.085619 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.067929 28899 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.086117 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.086390 28891 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.095438 28864 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.100136 28865 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.105693 28881 tablet_copy_client.cc:806] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:36.092916 28899 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:36.109872 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 95414.2us
I20260503 07:57:36.093055 28897 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.115773 28104 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.088305 28894 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.114046 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.112035 28881 tablet_copy_client.cc:670] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:36.119357 27926 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.112560 28897 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:36.116875 28835 consensus_queue.cc:1059] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:36.122437 27926 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.120630 28816 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.120532 28818 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.126801 28619 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:36.126191 28894 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.124046 28897 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.133173 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.134269 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.131916 28879 tablet_copy_client.cc:806] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:36.124184 28849 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.151085 28878 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:36.137537 28864 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.156147 28841 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.141453 28816 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260503 07:57:36.159281 28909 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.159690 28909 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:36.160001 28909 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.144804 28879 tablet_copy_client.cc:670] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:36.136722 28903 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.158924 28841 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:36.184749 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 62560.6us
I20260503 07:57:36.185518 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.182724 28910 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.195545 28910 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:36.193073 27926 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.198980 27926 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.195865 28910 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.200016 27926 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.191372 28863 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.207283 28863 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.200145 28903 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.201423 28835 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:36.249890 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 114624us
I20260503 07:57:36.250824 27999 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.253156 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.254248 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.257357 28822 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.257766 28822 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:36.258111 28822 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.260704 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.201751 28899 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.262717 28900 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.265844 28900 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:36.266075 28818 raft_consensus.cc:3055] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.266211 28900 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.266492 28818 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:57:36.267444 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 67497.5us
I20260503 07:57:36.264132 28879 tablet_copy_client.cc:538] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:36.283308 28881 tablet_copy_client.cc:538] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:36.262070 28905 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.285099 28905 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:36.285476 28905 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.271761 28865 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.274515 28109 raft_consensus.cc:1240] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.275259 28103 raft_consensus.cc:1240] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.275591 28909 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.276089 28102 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.276348 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.284519 28849 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.277740 27926 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.281371 28818 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.265033 28897 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.263989 28864 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:36.285930 28883 tablet_copy_client.cc:806] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:36.293891 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.298110 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.298143 27926 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.305365 27999 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.306120 28903 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.306340 28894 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.307054 28894 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.305740 27926 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.304701 28895 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.324328 28900 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.333806 28909 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.325773 28899 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:36.295811 28864 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:36.334566 28864 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.335094 28900 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.296538 28865 consensus_queue.cc:1059] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260503 07:57:36.299038 28816 consensus_queue.cc:1059] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260503 07:57:36.336325 28865 raft_consensus.cc:3055] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.336426 28816 raft_consensus.cc:3055] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.336722 28865 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.336830 28816 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.337565 28865 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.337795 28816 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.338658 28865 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.339098 28816 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.298416 28835 consensus_queue.cc:1059] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260503 07:57:36.341272 28895 raft_consensus.cc:3055] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.341593 28895 raft_consensus.cc:740] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.342260 28895 consensus_queue.cc:260] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.343425 28895 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.327338 28910 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.345672 28850 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.346578 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.329072 28818 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.308063 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.305202 28883 tablet_copy_client.cc:670] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:36.335142 28897 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.294893 28913 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.356411 28910 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.349453 28850 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.349656 27926 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:36.352759 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 44774.5us
I20260503 07:57:36.358557 27999 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:36.359839 28897 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.360020 28850 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.360047 28905 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.361378 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.362023 28897 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.362421 28905 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.362982 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.363617 28910 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.363945 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.363301 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.364717 28910 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.365167 28895 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.365031 27926 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.366528 27926 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.365007 27999 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.340765 28864 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.367588 27926 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.380131 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.368732 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.369102 28910 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.382270 28910 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.382390 27999 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.383003 28895 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.383735 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.384538 28897 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.353816 28894 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.380627 27926 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.386011 27926 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.387282 27926 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.388993 28895 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.367198 28850 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.389659 28895 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.384860 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.377352 28102 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.390911 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.391249 28897 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.391598 28911 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.375732 28103 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.393096 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.393853 28900 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.383744 28910 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.394183 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.388656 28818 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.394992 28910 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.375906 28879 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:36.395499 27999 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.396330 28910 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.388564 27926 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.366546 28865 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.396788 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.399165 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.398408 28864 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.399972 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.402583 28818 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.373970 28822 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.405187 28818 consensus_queue.cc:1059] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.406585 28883 tablet_copy_client.cc:538] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:36.378832 28881 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:36.401212 28865 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.400136 28905 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.402148 27926 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.413439 28816 raft_consensus.cc:3055] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.407545 28913 consensus_queue.cc:1059] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.417315 28865 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.418637 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.419237 28910 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.425954 28865 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:36.427026 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.427711 28865 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.421556 28822 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:36.417353 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.428061 27926 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.428900 28822 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.425204 28816 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.429282 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.429486 28913 raft_consensus.cc:3055] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.430389 28818 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.431035 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.430657 28913 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.432067 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.432094 28913 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.433128 28822 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.433319 28883 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:36.433787 28913 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.434186 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.434417 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.432492 28910 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.429960 27926 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.438632 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.436759 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.437876 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.438356 28028 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.437160 28822 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.440816 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.441212 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.441854 27926 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.442365 28865 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.442698 28895 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.442978 28865 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.443262 28878 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:36.444067 28878 tablet_bootstrap.cc:492] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:36.444720 28878 ts_tablet_manager.cc:1403] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.294s user 0.019s sys 0.007s
I20260503 07:57:36.445930 28816 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.447252 28816 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.448006 28103 raft_consensus.cc:1240] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.448602 28109 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.449692 28102 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.450410 28878 raft_consensus.cc:359] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.451109 28878 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:36.451622 28865 consensus_queue.cc:1059] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.451685 28878 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.452548 28865 consensus_queue.cc:1059] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.453377 28865 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.453948 28850 raft_consensus.cc:3055] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.454860 28895 raft_consensus.cc:3055] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.457300 28850 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.457418 28895 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.458073 28850 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.458213 28895 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.459153 28850 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.459302 28895 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.461886 28030 raft_consensus.cc:1240] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.462144 28865 raft_consensus.cc:3055] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.462483 28865 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:36.463392 28865 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.463999 28878 ts_tablet_manager.cc:1434] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260503 07:57:36.464442 28865 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.465533 28044 tablet_copy_service.cc:342] P adaf84b6ac60420ab03d39b9db9f0413: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-3d2e3ed8ebbe4d968d5ab9e678ea1561 received from {username='slave'} at 127.0.0.1:43620
I20260503 07:57:36.465929 28044 tablet_copy_service.cc:434] P adaf84b6ac60420ab03d39b9db9f0413: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-3d2e3ed8ebbe4d968d5ab9e678ea1561 on tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:36.476137 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.478080 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.479056 28032 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.480029 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.481160 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.482389 28029 raft_consensus.cc:1240] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.483307 28032 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.484328 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.485244 27926 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.485793 28026 raft_consensus.cc:1240] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.485985 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:36.485828 28895 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.489948 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.491241 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.492295 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:36.495886 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:36.496904 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.500399 28881 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:36.501247 28881 tablet_bootstrap.cc:492] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:36.501886 28881 ts_tablet_manager.cc:1403] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.123s user 0.023s sys 0.003s
I20260503 07:57:36.503489 27959 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:36.508299 28881 raft_consensus.cc:359] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.509241 28881 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:36.509344 27958 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:36.508847 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.509903 28881 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.511372 27960 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.513412 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.520507 27959 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:36.520814 28881 ts_tablet_manager.cc:1434] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.019s user 0.005s sys 0.002s
I20260503 07:57:36.527455 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.530079 28044 tablet_copy_service.cc:342] P adaf84b6ac60420ab03d39b9db9f0413: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-4029065128b84be9a45c0bfe2af75b6f received from {username='slave'} at 127.0.0.1:43620
I20260503 07:57:36.530486 28044 tablet_copy_service.cc:434] P adaf84b6ac60420ab03d39b9db9f0413: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-4029065128b84be9a45c0bfe2af75b6f on tablet 4029065128b84be9a45c0bfe2af75b6f with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:36.534070 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.540707 28106 raft_consensus.cc:1240] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.547534 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.549633 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.550664 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.551333 27960 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:36.552893 28075 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.554190 28075 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.554872 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.558523 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.558081 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.558993 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.560484 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.561342 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.564953 28027 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.565810 28879 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:36.566617 28879 tablet_bootstrap.cc:492] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:36.554773 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.567288 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:36.568579 28879 ts_tablet_manager.cc:1403] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.193s user 0.023s sys 0.003s
I20260503 07:57:36.568614 28027 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.569325 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.570103 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.570942 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.571266 28075 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.554571 28892 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.572328 28894 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.572443 28910 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.572901 28028 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.568785 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:36.572897 28822 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.573346 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:36.569226 28874 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.574816 28910 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:36.575243 28910 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:36.575788 28892 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:36.576023 28910 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.576804 28075 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.578986 28902 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.579892 28075 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.584690 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:36.585803 27923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:36.588186 28075 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.588856 28892 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.586071 28902 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.587440 28907 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.589794 28892 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.590140 28892 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:36.590250 28822 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:36.590668 28822 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:36.590778 28892 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.591389 28822 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.591935 28892 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.598673 28902 consensus_queue.cc:1059] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.598824 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.600250 28899 raft_consensus.cc:3055] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.600417 28907 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.600620 28899 raft_consensus.cc:740] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:36.603223 28899 consensus_queue.cc:260] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.604792 28075 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.607739 28894 consensus_queue.cc:1059] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:36.608831 28900 raft_consensus.cc:3055] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.609146 28900 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:36.609840 28900 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:36.611726 28900 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.604583 28899 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.619129 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:36.621337 27923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:36.619819 28883 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:36.619757 28907 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.602363 28879 raft_consensus.cc:359] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.622233 28883 tablet_bootstrap.cc:492] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:36.622727 28900 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:36.623695 28900 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:36.622273 28879 raft_consensus.cc:740] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:36.624802 28879 consensus_queue.cc:260] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
W20260503 07:57:36.626561 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:36.623034 28883 ts_tablet_manager.cc:1403] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.190s user 0.013s sys 0.008s
I20260503 07:57:36.630774 28883 raft_consensus.cc:359] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.635499 28883 raft_consensus.cc:740] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:36.636116 28883 consensus_queue.cc:260] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.638485 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:36.633603 28902 consensus_queue.cc:1059] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.639458 28902 raft_consensus.cc:3055] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.639792 28902 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:36.640532 28902 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.641820 28902 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.634874 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.635205 28879 ts_tablet_manager.cc:1434] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.059s user 0.006s sys 0.000s
I20260503 07:57:36.631976 28900 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.647814 28075 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.648864 28874 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.649341 28883 ts_tablet_manager.cc:1434] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260503 07:57:36.649857 28894 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:36.649798 27854 catalog_manager.cc:5671] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:36.646994 28907 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.650738 28118 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-d4a767f631d84b75af79d3964f3a548f received from {username='slave'} at 127.0.0.1:59398
I20260503 07:57:36.652136 28118 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-d4a767f631d84b75af79d3964f3a548f on tablet d4a767f631d84b75af79d3964f3a548f with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:36.654903 28118 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-c9d2b513dd664ccfbfcbd9f74fe0dddf received from {username='slave'} at 127.0.0.1:59398
I20260503 07:57:36.655360 28118 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-c9d2b513dd664ccfbfcbd9f74fe0dddf on tablet c9d2b513dd664ccfbfcbd9f74fe0dddf with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:36.654469 28894 raft_consensus.cc:697] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:36.661572 28894 consensus_queue.cc:237] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:36.668912 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:36.669925 28891 consensus_queue.cc:1059] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.670899 28902 raft_consensus.cc:3055] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.671195 28902 raft_consensus.cc:740] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:36.671846 28902 consensus_queue.cc:260] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.673692 28902 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.685220 28891 consensus_queue.cc:1059] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.686162 28907 raft_consensus.cc:3055] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.686554 28907 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:36.687294 28907 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.688580 28907 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.706867 28899 consensus_queue.cc:1059] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:36.707295 28619 raft_consensus.cc:1217] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20260503 07:57:36.708032 28907 raft_consensus.cc:3055] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.708425 28907 raft_consensus.cc:740] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:36.710613 28907 consensus_queue.cc:260] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:36.716264 28907 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.716320 28619 raft_consensus.cc:1217] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:36.717032 28075 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.734977 28902 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.738737 28028 raft_consensus.cc:1240] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:36.741425 28075 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:36.742658 28891 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.770849 28894 consensus_queue.cc:1059] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:36.771507 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.771836 28910 raft_consensus.cc:3055] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:36.772222 28894 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.772251 28910 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:36.772562 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.773329 28910 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:36.773834 28822 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.773955 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.774827 28910 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:36.775058 28894 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.775476 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.775542 27855 catalog_manager.cc:5671] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:36.778026 27999 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.777693 27855 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:36.778785 28822 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.779330 28822 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.779147 27855 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:36.780532 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:36.781215 28822 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:36.911826 28619 raft_consensus.cc:1217] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:36.941771 28103 raft_consensus.cc:1240] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:37.550210 28933 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:37.550704 28932 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:37.551600 28932 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:37.551430 28933 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:37.568670 28933 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:37.569669 28932 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:37.600100 28935 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:37.600932 28935 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:37.611438 28935 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:37.704661 28941 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:37.705566 28941 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:37.793830 28941 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:37.938959 28941 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:37.939855 28941 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:37.942162 28941 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.044371 28942 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.045166 28942 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.047643 28942 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:38.048194 28942 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.048792 28942 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.051291 28942 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.179924 28942 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.180848 28942 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.183313 28942 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.326556 28942 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.327363 28942 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.329869 28942 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:38.434602 28000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s user 0.034s sys 0.049s
W20260503 07:57:38.435815 28000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s user 0.034s sys 0.050s
W20260503 07:57:38.438083 28073 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s user 0.020s sys 0.073s
W20260503 07:57:38.438586 28073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s user 0.021s sys 0.074s
I20260503 07:57:38.448482 28943 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:57:38.459196 28074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s user 0.000s sys 0.009s
W20260503 07:57:38.459712 28074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s user 0.001s sys 0.009s
I20260503 07:57:38.459976 28941 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.462330 28941 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:38.461268 28942 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.472139 28946 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.472312 28942 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.459687 28943 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.475801 28942 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.472740 28946 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.476374 28942 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.478729 28942 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.480944 28942 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.481455 28942 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.482147 28942 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.474165 28941 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.478709 28946 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.495942 28943 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.498634 28947 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.499293 28947 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.499912 28942 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.502983 28947 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.505275 28952 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.506002 28952 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.508489 28952 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:38.510679 28942 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.510926 28941 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.511355 28942 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.511579 28941 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.512409 28950 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.515981 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.516860 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.517562 27959 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:38.517627 28951 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.518237 28951 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.520390 28951 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.521453 28941 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.521914 28941 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.522382 28941 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.515345 28942 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.525321 28945 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.520882 28951 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.529219 28943 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.529284 28951 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.516880 27955 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:38.512964 28950 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.528021 28947 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.529934 28943 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.536180 28941 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.537616 28942 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.598039 28944 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.598448 28955 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.598639 28944 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.599156 28955 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.600133 28943 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.600720 28944 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:38.593389 28130 debug-util.cc:398] Leaking SignalData structure 0x7b08000598e0 after lost signal to thread 26795
I20260503 07:57:38.600616 28942 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.601058 28955 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.598995 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.593837 28946 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.595116 28941 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.594969 28947 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.598523 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.627861 28953 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.621833 28949 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.628539 28949 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.627905 28941 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.630554 28949 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.631096 28941 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.627986 28948 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.631834 28948 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.632594 28942 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:38.602692 28945 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.633342 28954 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.633813 28948 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.633926 28954 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.634766 28945 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.631587 28949 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.628504 28953 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.622561 28955 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.637148 27951 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:38.635164 28951 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.636325 28941 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.625852 28943 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.635927 28944 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.654791 28941 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.654889 28944 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.655737 28953 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.656454 28947 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.656677 28941 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.657006 28943 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.654886 28949 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.659150 28943 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.659336 28949 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.657055 28957 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.659919 28949 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.660138 28962 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.654951 28955 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.654809 28956 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.661372 28950 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.661742 28956 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.626178 28946 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.662308 28955 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.662796 28954 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.654414 28951 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.650014 28948 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.663568 28951 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.663831 28946 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.644369 28942 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.664057 28948 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.655251 28959 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.665565 28963 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.665516 28959 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.664682 28942 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.660262 28957 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.667847 28942 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.656862 28944 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.668509 28957 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.665525 28951 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.663763 28956 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.660514 28949 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.666057 28948 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.660734 28962 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.666251 28963 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.684782 28953 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.685490 28953 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:38.687515 28953 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.669016 28957 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.683724 28949 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.698786 28951 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.702582 28951 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.691825 28952 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.704568 28951 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.704468 28952 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.706769 28952 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.693640 28946 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.693538 28941 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.692981 28954 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.698583 28944 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.713085 28945 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.721191 28941 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.713629 28962 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.713922 28965 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.709861 28960 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.714530 28946 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.712399 28949 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.755139 28949 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.757572 28949 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.765197 28960 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.767619 28960 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:38.768371 28958 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.769317 28959 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.769101 28958 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.769842 28965 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.771097 28958 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.719709 28954 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.701303 28957 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.722275 28945 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.712886 28950 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.722648 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:38.721619 28961 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.717514 28951 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.723403 28952 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.724265 28971 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.728972 28964 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.724838 28970 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.725873 28969 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.726688 28944 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.727710 28943 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.694736 28942 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.729280 28953 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.771929 28948 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.724807 28966 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.754122 28962 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.850920 28984 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.851011 28950 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.851488 28962 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.852082 28946 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:38.851923 28984 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.771842 28965 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.853125 28950 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.853305 28965 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.853645 28950 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.853852 28965 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.854125 28950 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.855581 28950 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.855643 28965 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.837317 28971 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.857378 28976 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.857568 28971 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.823670 28956 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.857965 28976 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.858166 28953 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.850947 28972 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.859543 28972 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.860322 28953 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.850678 28943 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.837514 28952 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:38.841097 28951 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.863224 28943 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.850574 28969 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.863500 28952 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.850528 28949 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.829033 28617 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:38.753747 28955 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.857857 28948 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.858219 28956 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.837394 28961 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.872074 28942 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:38.873425 28956 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.873564 28961 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:38.873822 28972 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.873924 28942 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.874419 28967 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.874565 28966 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.874993 28967 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.875440 28948 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.820197 28958 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.876178 28958 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.876629 28966 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.849268 28964 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.829705 28960 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:57:38.823287 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 73587.5us
I20260503 07:57:38.824465 28959 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.864549 28949 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.838222 28970 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.862074 28945 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.876955 28967 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.883059 28944 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.881840 28962 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:38.884644 28957 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.906204 28962 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.885807 28955 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.906687 28962 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.907704 28949 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.908412 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.914608 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.914394 28959 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:38.915344 27958 raft_consensus.cc:2393] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:38.915519 28962 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.915298 27953 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:38.888069 28978 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:38.878177 28954 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.891809 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:38.908820 28130 debug-util.cc:398] Leaking SignalData structure 0x7b080017a580 after lost signal to thread 27891
I20260503 07:57:38.910923 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:38.878343 28958 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.877821 28104 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:38.896991 28942 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.893005 28965 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.889222 28975 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.970765 28975 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.913491 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.913899 28970 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.914481 28964 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.879020 28982 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.892463 28950 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.888399 28977 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.916148 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:38.886648 28985 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.905643 28967 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.940806 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53082 (request call id 57) took 1984 ms. Trace:
I20260503 07:57:38.925201 28073 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:38.931761 28955 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.924431 28949 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:38.880868 28956 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.935271 28951 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.977448 27955 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:38.905371 28960 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.931732 28954 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.886152 28987 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.937151 28959 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.971936 28103 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
W20260503 07:57:38.981391 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 56287.4us
I20260503 07:57:38.979041 28964 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:38.983263 28970 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:38.987888 28950 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.988338 28970 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.988004 28964 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.988739 28970 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:38.981243 28967 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.989955 28964 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.990021 28950 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.990309 28967 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.982059 28617 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:38.990995 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:38.985389 28965 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:38.985543 28951 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:38.992076 28951 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.993046 28965 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.993798 28951 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.994408 28960 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.995301 28975 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.995661 28977 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.996222 28985 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:38.997215 28977 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.979944 28982 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.998365 28102 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:38.981958 28942 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:38.993562 28956 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:38.999119 28982 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:38.999697 28949 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.000417 28942 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.000998 28989 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.001174 28949 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.001682 28954 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.001561 28989 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.002233 28941 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.003201 28954 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.003655 28989 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.979447 27855 rpcz_store.cc:276] 0503 07:57:36.956881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:37.618214 (+661333us) service_pool.cc:224] Handling call
0503 07:57:38.940637 (+1322423us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260503 07:57:39.008817 28992 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:39.009508 28992 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:38.998520 28985 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:39.011296 28130 debug-util.cc:398] Leaking SignalData structure 0x7b08003260e0 after lost signal to thread 27984
I20260503 07:57:39.012594 28987 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.014308 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.016453 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.016703 28984 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.017220 28614 raft_consensus.cc:2393] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:39.019793 28963 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.022599 28103 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:39.024207 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.025221 27958 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:39.025494 28987 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:39.026177 28130 debug-util.cc:398] Leaking SignalData structure 0x7b0800326920 after lost signal to thread 28059
W20260503 07:57:39.026461 28130 debug-util.cc:398] Leaking SignalData structure 0x7b0800326940 after lost signal to thread 28060
W20260503 07:57:39.027375 28130 debug-util.cc:398] Leaking SignalData structure 0x7b0800098100 after lost signal to thread 28133
I20260503 07:57:39.028568 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.029142 27958 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:38.923926 28978 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.030087 28969 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:38.985271 28955 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:39.031224 28955 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:39.031970 28130 debug-util.cc:398] Leaking SignalData structure 0x7b080030f2e0 after lost signal to thread 28647
I20260503 07:57:39.033171 28962 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.033305 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.033726 28962 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.034457 28986 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:39.035485 28962 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.003893 28976 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.011435 28992 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:39.000484 28956 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.034983 28986 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.036520 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:38.982180 28958 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.037392 28101 raft_consensus.cc:2393] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.037842 28986 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.037331 28958 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:39.038655 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 51475.9us
I20260503 07:57:39.039552 28073 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.039927 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.040314 28966 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.040513 28073 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.040633 28978 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.041301 28952 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.041540 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.043056 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.043066 28958 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.043568 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.040704 28966 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.043849 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.044159 28100 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.044210 28966 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.044402 28955 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.045459 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.046010 28100 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.046305 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.047911 28104 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.048193 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.041663 28952 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.049463 28952 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.052953 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.053220 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.053476 27954 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.054380 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.054857 27960 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.055662 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.056152 27956 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.057091 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.057653 27957 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.057880 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.058019 28944 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.057948 28948 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.058590 28109 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.058741 28948 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.058651 28944 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.060026 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.060587 27955 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.060645 28948 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.061398 28948 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.061475 28944 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:39.061542 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.061978 28948 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.062284 27953 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.063278 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:39.055764 28952 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.064076 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.070876 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.071411 27955 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.072883 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.073391 27955 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.074054 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:39.074944 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 141167us
I20260503 07:57:39.075007 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.075620 27955 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.076182 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.076406 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.076786 28981 consensus_queue.cc:1059] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:39.065290 28944 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.077502 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.077507 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.065930 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.078218 27952 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.078645 27955 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.078729 27954 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.078912 28981 raft_consensus.cc:3055] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:39.079140 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.079304 28981 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:39.079424 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.079969 27955 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.066404 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.081310 27959 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.081827 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.066517 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.080219 28981 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.064813 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.071318 28959 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.083091 28101 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:39.083326 28959 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.083730 28959 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.067587 28102 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:39.083132 28981 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.063926 28948 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.067874 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.090903 28028 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:57:39.068989 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.092031 28027 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:39.069295 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.092782 28033 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:57:39.069962 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.070099 28955 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.070253 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.093689 27953 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.093585 28955 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.092059 28585 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.094424 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.094961 28617 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.095088 28585 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:39.095345 28955 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.095906 28972 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.096228 28972 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.096284 28957 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.096589 28972 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.096668 28957 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.097102 28957 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.064064 28583 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:39.071326 27960 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:38.998481 28970 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.101265 28980 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.101600 28980 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.077826 28944 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.102101 28992 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:39.102578 28972 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.103447 28944 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.065621 28947 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.104192 28947 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.104514 28972 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.105345 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.105748 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.105890 28614 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.105963 28947 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.106436 28619 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:39.110186 28952 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.110716 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:39.111254 28035 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.084715 28966 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.101900 28980 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.112767 28958 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:39.113227 28958 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.115013 28958 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:39.114876 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:39.115724 28958 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.116055 28958 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.116361 28958 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.101905 28970 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.119356 28035 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:57:39.121161 28966 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.121716 28585 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.123224 28959 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.123749 27924 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:39.124122 28972 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.124476 28986 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.122901 28958 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.125304 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.124573 28957 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.126242 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.126788 28617 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.127354 28957 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.128484 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.125291 28986 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.128926 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.129443 28986 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.129639 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.128392 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.130362 27959 raft_consensus.cc:2393] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:39.131578 28959 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.132164 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.133134 27924 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.133198 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.133831 28985 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.134205 28985 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.134586 28985 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.135070 27960 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:39.135748 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.135906 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.134084 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.136914 27952 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.137343 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.137971 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.138336 28986 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.139448 27959 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:39.140130 28986 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:39.140372 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.140898 27960 raft_consensus.cc:2368] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:39.124142 28980 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.141494 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.142114 27958 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.143041 28980 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.142735 28985 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.143653 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:39.143937 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.144157 28033 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.144506 28102 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:39.145087 28985 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.145745 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.146590 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:39.146745 27924 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:39.147358 28993 raft_consensus.cc:2764] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260503 07:57:39.147490 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.148356 28102 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:39.148514 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:39.147908 28617 raft_consensus.cc:2393] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:39.148728 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.149339 28101 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:57:39.150127 27954 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:39.150290 28958 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:39.147490 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.152652 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.153121 27958 raft_consensus.cc:2393] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:39.153177 28101 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:57:39.154217 28993 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:39.147519 28985 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.154929 28985 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.155243 28985 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.156312 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.156829 28101 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.160135 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:39.160820 28617 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:39.161296 28035 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:39.161592 28033 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:57:39.162212 28585 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:39.163403 28585 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:39.164143 28959 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:39.164530 28980 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.164630 28959 raft_consensus.cc:697] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 2 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:39.164985 28985 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.165755 28959 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.166678 28985 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:39.167613 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:39.165148 28980 raft_consensus.cc:697] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:39.169854 28980 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.172897 28101 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:57:39.174417 27924 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.175050 28985 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.175063 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.175621 28985 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.175217 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.175980 28985 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.176221 28981 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:39.180898 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.181464 27954 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.185276 27924 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.185998 28958 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.186360 28958 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.186719 28958 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.189350 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.192217 28972 raft_consensus.cc:697] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:39.194108 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.194761 28958 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.195672 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.197465 28958 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.197602 28583 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:39.194981 28073 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:39.194737 27959 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.199436 28073 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.191107 28101 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.202157 28959 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.202294 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.202536 28959 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.202919 28959 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.202948 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.203723 28100 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.202173 28966 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:39.205327 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.198763 28957 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.205955 28103 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.206656 28985 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.207013 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.207536 28104 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.208241 28970 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.208633 28970 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.209048 28970 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.213304 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.215009 28952 raft_consensus.cc:1064] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:39.215234 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.215898 28583 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:39.216682 28985 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.216837 28957 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.217370 28957 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.217449 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.217919 28957 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.218097 28108 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.219235 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.236892 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.251791 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.242343 27959 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.222469 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.251487 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.225687 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.282423 28106 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
W20260503 07:57:39.241003 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:39.224054 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:39.285362 27954 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.291280 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:39.285502 28959 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.294499 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:39.288630 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:39.252720 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.237316 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.289108 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.295547 28970 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.295842 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:39.296576 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.286060 27960 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:39.297518 27955 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:39.298219 27956 raft_consensus.cc:2368] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:39.222177 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.295642 27957 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.295071 27954 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:39.283239 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.253562 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.296590 28109 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.300920 28959 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.299196 28105 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.301641 28970 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:39.202487 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.302116 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.302601 28102 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.228503 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.303431 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.303836 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.304530 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.296028 27952 raft_consensus.cc:2393] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:39.302064 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.225414 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.285676 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.306046 28100 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.223908 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.306969 28107 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.307165 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.307732 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.308760 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.309052 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.309437 28107 raft_consensus.cc:2393] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.309728 28947 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.308456 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.310070 28947 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.251614 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.310322 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.310410 28947 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.310985 28106 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.310734 28957 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.311694 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.312826 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.313089 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:39.312860 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.314412 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.315565 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.231093 28981 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260503 07:57:39.304862 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.317072 28947 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.317590 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.205075 28972 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.219877 28101 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:57:39.319197 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.319715 28947 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.313225 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.222326 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.322506 28105 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.323138 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.324288 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.324819 28104 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.237457 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.316857 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.319361 28073 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.318310 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.329105 28957 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.329385 28106 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.329702 28073 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.330121 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.316226 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.330718 28966 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.331115 28966 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.331393 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.225553 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.331957 28947 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.332168 27958 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:39.330493 28073 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.332327 28947 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.320644 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.332893 28947 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.332965 28944 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.333382 28109 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.333498 28944 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.333904 28944 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.334149 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.334767 28109 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:39.331486 28966 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.338778 28073 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.331117 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.340106 28948 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.340466 28948 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.340775 28948 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.232851 28952 consensus_queue.cc:237] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.341720 28073 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.339434 28947 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.342500 28963 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.342867 28963 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.343204 28963 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.321563 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.330049 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.349260 28101 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.350046 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.350544 28101 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.351331 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.352290 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.350752 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.321244 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.332319 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.352053 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.353250 27957 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:39.332516 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.353403 28108 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.353826 28107 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:39.354069 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.354447 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.354549 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.355065 28108 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.355238 28107 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.356109 28107 raft_consensus.cc:1240] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:39.345496 28073 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.310276 28100 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.353587 27958 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.369029 28104 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:39.354682 28109 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:39.347951 28947 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.348507 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.357754 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.352802 28101 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:39.359470 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.359323 28963 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.373822 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.374168 27952 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:39.375254 28963 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.359896 28966 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.360297 28948 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.375880 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.376017 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.376516 27957 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:39.376786 28101 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.377516 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.377632 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.361063 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.385717 28107 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.361819 28073 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.362753 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.364748 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.387161 28963 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.365592 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.366552 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.388360 27959 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:39.368543 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:39.389220 27954 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.360491 28944 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.372810 28102 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.371935 27857 catalog_manager.cc:5671] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 3 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:39.370146 28970 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.390753 28970 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.391122 28970 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.377686 28103 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.394073 28102 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260503 07:57:39.377146 28948 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.360978 27953 raft_consensus.cc:1240] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:39.369656 28105 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:39.365108 28617 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:39.387542 28963 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.387521 28073 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.401249 28963 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.401850 28073 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.402592 28073 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.403327 28073 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.404539 28073 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.373351 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:39.392297 28944 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.385051 28966 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.397125 28106 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.380595 28100 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:39.405277 28109 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:39.408550 28990 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.409508 28955 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:39.411120 28990 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.411527 28990 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.406881 28947 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.407886 28943 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.413372 28073 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.413591 28943 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.413980 28943 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.406417 28948 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.415333 28948 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.415752 28948 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.415504 28963 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.413398 28947 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.417642 28947 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.420616 28993 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:39.400645 28970 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.418642 28073 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.418991 28963 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.425637 28961 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.425953 28101 raft_consensus.cc:2393] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.426007 28961 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.426553 28961 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.427002 28970 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.427654 28073 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.428403 28970 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.428797 28970 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.419296 28968 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.428916 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.429278 28968 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.429694 28968 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.431002 27999 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.432093 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.429267 28970 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.432617 28992 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.432845 28973 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.433296 28973 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.434679 28973 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.435796 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.436880 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.437316 28955 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.438295 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.438501 28955 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:39.439380 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.440372 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.440869 28962 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.441004 28979 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.441394 28949 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.441334 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.441879 28949 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:39.442297 28949 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.442536 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.443163 28962 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.443612 28979 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.443869 27999 leader_election.cc:400] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:39.443708 28962 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:39.444193 27999 leader_election.cc:403] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:57:39.440217 28981 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.444792 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.444981 28962 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:39.445755 28962 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.446053 28962 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:39.446257 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.447013 28977 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.447116 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.447396 28977 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.447783 28977 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.448052 27999 leader_election.cc:400] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:39.448343 27999 leader_election.cc:403] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:57:39.448866 28981 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.448992 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.449259 28981 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.449553 28981 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.446408 28962 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.452589 28952 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.453040 28960 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.453408 28960 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.453512 28952 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.453758 28960 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.453944 28952 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.459551 28979 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.469235 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.470026 28073 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.470634 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.470829 28966 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:39.471282 28966 raft_consensus.cc:697] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.471211 28961 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.471598 27999 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.472323 28965 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.472245 28966 consensus_queue.cc:237] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.472579 27999 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.472743 28965 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.473299 28961 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.473438 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.473333 28967 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.473739 28965 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.474684 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.474236 28950 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.475492 28950 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.475828 28950 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.475752 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:39.476452 28964 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.476790 28964 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:39.475508 28945 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.477597 28945 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.477237 28964 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.477977 28945 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.474200 28967 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:39.477130 28978 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.478778 28073 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.439422 28993 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:39.429248 28943 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.481452 28967 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.482822 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.473131 28992 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.482802 28978 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.482385 28955 consensus_queue.cc:1059] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260503 07:57:39.527307 28993 raft_consensus.cc:3055] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:39.527650 28993 raft_consensus.cc:740] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:39.528450 28993 consensus_queue.cc:260] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.529714 28993 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.485185 28944 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.531459 28944 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.531854 28944 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.510097 28992 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:39.570519 28992 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.540578 28978 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:57:39.601423 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 118663us
I20260503 07:57:39.602286 28943 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.602610 28961 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.604596 28961 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.604897 27924 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.605744 27924 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.608225 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.608558 27924 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.611598 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.612098 27955 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.614019 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.614218 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.614641 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.614842 27953 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.614871 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.614295 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.616379 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.616833 27954 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.604897 28961 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.611960 28958 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.617815 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:39.621004 28958 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:39.621388 28958 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.621486 28617 raft_consensus.cc:2393] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 2: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:39.618742 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:39.608572 28985 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.624182 28985 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:39.624548 28985 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.625205 28972 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.625653 28972 raft_consensus.cc:697] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:39.626410 28972 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.619211 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.628816 27960 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.629877 28617 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:39.631443 28028 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:39.619588 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.633071 28980 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:39.633332 27956 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.633450 27924 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.634260 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.619982 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.615842 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.614713 27951 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260503 07:57:39.667339 28999 log.cc:927] Time spent T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260503 07:57:39.667896 27960 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.668085 28979 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:39.664275 28969 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.669097 28969 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.669390 28969 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.671299 27955 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.679812 28986 raft_consensus.cc:2764] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260503 07:57:39.690580 27951 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:39.691160 28986 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.691006 28990 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.691509 28986 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:39.691874 28986 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.698411 27951 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:39.701205 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.704591 27956 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.694909 27953 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.705958 28947 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:39.696451 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 62270.6us
I20260503 07:57:39.710861 27954 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.628980 28961 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.710445 28947 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.717469 28977 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.721582 28980 consensus_queue.cc:1059] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:57:39.722690 28977 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.718573 28962 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.724926 28962 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.722708 28980 raft_consensus.cc:3055] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:39.725855 28980 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:39.726617 28980 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:39.727641 28981 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:39.730635 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:39.688705 28965 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.617938 28968 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.734632 28028 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:39.735334 28985 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:39.713032 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:39.742336 28948 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.743557 28970 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.745162 28986 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.752501 28027 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.752767 28986 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.741856 28968 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.752929 28990 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.749362 28965 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.712527 28972 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260503 07:57:39.727663 28980 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.767271 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.769306 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.769848 27957 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.772173 28970 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.772936 28969 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.773224 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.773841 28107 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.773761 28968 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:39.774806 28969 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.776108 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.776440 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.773283 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.777328 27959 raft_consensus.cc:2393] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:39.777354 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:39.776594 27960 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.778395 28104 raft_consensus.cc:2393] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:39.779728 28101 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:39.779620 28945 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.781580 28961 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.782466 28981 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.784895 27960 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.785336 28950 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.791749 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.792400 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.785686 28972 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260503 07:57:39.793848 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 56318.6us
I20260503 07:57:39.787585 27957 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.789270 27955 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.794729 27924 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:39.804984 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:39.797864 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.816517 28969 raft_consensus.cc:2764] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260503 07:57:39.793118 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.819360 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.819937 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.822589 28073 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.823297 28950 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.788671 28945 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.757860 28973 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.824532 28990 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:39.825405 28973 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.825940 28968 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.826033 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.826448 28968 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.826599 28033 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.827353 28968 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.828177 28985 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.759095 28964 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.829335 28073 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.833149 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.833951 28073 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.834895 28970 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.834996 28073 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.836014 28964 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.836248 28970 raft_consensus.cc:697] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.836678 28943 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.820514 28986 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:39.837173 28943 raft_consensus.cc:697] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.837384 28986 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:39.835163 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.840483 28107 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:39.842831 27924 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.843458 28985 raft_consensus.cc:2764] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260503 07:57:39.846057 28943 consensus_queue.cc:237] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.839927 28986 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.849303 28073 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.849989 28947 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.850414 28947 raft_consensus.cc:697] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.851194 28947 consensus_queue.cc:237] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:39.837177 28970 consensus_queue.cc:237] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.828966 28944 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.859073 28073 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.861474 27955 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.844753 27924 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.865072 28985 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.865434 28985 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:39.865824 28985 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:39.865662 28958 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.866714 28949 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.867481 28958 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.868350 27952 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.868522 28949 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.835749 28973 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.865566 28963 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.856993 28948 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.869727 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.872740 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.873257 27956 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.840677 28966 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.864662 27924 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.874233 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:39.875811 27960 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:57:39.875978 27924 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.889230 27960 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.890548 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.891260 28028 raft_consensus.cc:2393] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:39.892114 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.892695 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.894107 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.895282 28969 raft_consensus.cc:2764] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260503 07:57:39.895387 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.896179 28026 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:39.879480 28958 raft_consensus.cc:2764] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260503 07:57:39.897359 28031 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:39.869345 28973 raft_consensus.cc:697] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.899521 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.870025 28963 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.902071 28035 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:39.903007 28980 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:39.906064 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.907759 27924 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.909286 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.909183 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.869282 28992 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.921458 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.922340 28034 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:57:39.893641 28966 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.927910 27956 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.928913 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.907343 29005 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.908757 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.929502 28967 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.925166 28958 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:39.932655 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:39.926762 28027 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:39.929380 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.910933 28952 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.932179 28982 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:39.943101 27924 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:39.936352 29005 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:39.948356 28982 raft_consensus.cc:697] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:57:39.985314 29014 log.cc:927] Time spent T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.068s user 0.000s sys 0.002s
I20260503 07:57:39.985765 28985 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.944286 28969 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:39.986503 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.932533 28960 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.019307 28029 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.020015 28960 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.992161 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.021204 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.021869 28027 raft_consensus.cc:2393] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:39.936578 28958 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:40.022045 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:39.995087 28952 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:39.995358 28966 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:39.997056 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.998226 28986 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.025635 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.041674 28027 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:40.043018 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.000514 27952 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:40.044054 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.044816 28960 raft_consensus.cc:1064] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:40.045248 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:40.008009 28978 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.009342 28992 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.991022 28963 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.047665 28964 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:40.051587 28978 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:40.016613 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:40.053241 27957 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:40.053426 28028 raft_consensus.cc:2393] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.018126 28967 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.937680 28583 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:40.021220 27955 raft_consensus.cc:1275] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:40.020836 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:39.994820 28944 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:40.022064 28073 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.023679 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:40.060983 27956 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:40.025416 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:40.061546 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 129234us
I20260503 07:57:40.061825 28026 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.062556 28970 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:40.062960 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.060395 28978 consensus_queue.cc:1059] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260503 07:57:40.063314 28957 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:40.063905 28978 raft_consensus.cc:3055] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:40.064054 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.064256 28978 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:40.064577 28026 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:40.064813 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.064975 28978 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:40.030372 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.030486 28982 consensus_queue.cc:237] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.033911 28985 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.948989 28973 consensus_queue.cc:237] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.040607 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.046339 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.041010 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.043098 28986 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:39.941504 28030 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:40.003398 29007 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:40.055912 28031 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:40.025962 28958 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:40.065986 28960 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:40.069427 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.072749 28029 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.034685 27854 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 3 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:40.074177 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.075800 28073 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.066022 28978 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:40.078037 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 135027us
I20260503 07:57:40.064697 28957 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260503 07:57:40.062916 28583 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:40.079165 28033 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:57:40.124619 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.121562 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.079238 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.141314 28035 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:40.081650 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.127967 27957 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:40.143426 28032 raft_consensus.cc:2393] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
W20260503 07:57:40.129617 29018 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.105s user 0.000s sys 0.001s
I20260503 07:57:40.144409 28034 raft_consensus.cc:2393] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.142237 27924 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:40.143782 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 68008.3us
I20260503 07:57:40.144143 28952 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:40.146387 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.148767 27924 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.149528 28969 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:40.149616 27924 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.149992 28969 raft_consensus.cc:697] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:40.150836 28969 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.155373 28969 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:40.155787 28969 raft_consensus.cc:697] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:40.156577 28969 consensus_queue.cc:237] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.148187 28033 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:40.162084 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.162341 28073 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.162745 28032 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.163410 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.163497 28943 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:40.164734 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.164903 28943 raft_consensus.cc:697] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:40.165359 28032 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.122722 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.072477 28970 raft_consensus.cc:697] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:40.180012 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.112663 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.142957 28964 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:40.180943 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.182914 28033 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:40.113255 29007 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:57:40.186160 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 123318us
I20260503 07:57:40.186640 29007 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.187636 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.189116 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.189291 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.184631 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.189771 28032 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.187271 28030 raft_consensus.cc:2393] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.078313 28947 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260503 07:57:40.190061 28034 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:40.179605 28985 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:40.180389 28986 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:40.192833 28033 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:40.196338 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.196447 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.196807 28034 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:40.182508 28952 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:40.197454 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.197696 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.191830 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.198717 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.199266 28107 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:40.200356 28106 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:40.198391 28029 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:40.200475 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.200968 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.201556 28031 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:40.204007 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.195782 28985 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:40.129251 29005 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.233194 28985 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:40.195313 28986 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:40.165683 28943 consensus_queue.cc:237] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.239065 28107 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:40.203890 28980 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:40.240113 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.240916 27924 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.197660 28952 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.238780 28986 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:40.275529 29021 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
W20260503 07:57:40.276701 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.203646 28970 consensus_queue.cc:237] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.283234 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.287113 28032 raft_consensus.cc:2368] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
W20260503 07:57:40.290839 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.293757 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.294497 28033 raft_consensus.cc:2368] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:40.295351 28035 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:40.239799 28968 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:40.322999 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.323781 28032 raft_consensus.cc:2368] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:40.306998 28980 raft_consensus.cc:697] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 2 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:40.344089 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.345124 28958 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:40.345964 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.352047 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.353139 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.354140 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.355126 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.356146 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.356812 28027 raft_consensus.cc:2368] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:40.346102 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.346601 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.362051 28031 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:40.349371 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.350312 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.363472 28029 raft_consensus.cc:2368] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:40.364939 28035 raft_consensus.cc:2368] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:40.404143 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:40.423775 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.422941 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.426522 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.427181 28107 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:40.430802 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.431641 28035 raft_consensus.cc:2368] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:40.432544 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.403838 28958 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:40.434762 28032 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:40.424609 28966 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:40.454455 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.446944 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.446540 28980 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:40.457216 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.445091 28966 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.502264 28966 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:40.507063 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.524083 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.525347 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.526468 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.527560 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.486325 28107 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:40.528299 28033 raft_consensus.cc:2393] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:40.529354 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.532577 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.534425 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.500396 28026 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:40.535631 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.536720 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.540961 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.542321 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.549743 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.550496 28031 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:40.551581 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.554085 28029 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:40.556170 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.516885 28986 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.560473 28986 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:40.571300 28028 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:40.574257 28985 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.579253 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.579607 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.589725 28027 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:40.583649 28107 raft_consensus.cc:1240] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.584146 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.595710 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.596870 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.597708 28029 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:40.598569 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.584467 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.584704 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.585263 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.605396 28033 raft_consensus.cc:2368] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:40.606940 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.607944 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.609205 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.576994 28985 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:40.603669 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:40.585523 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:40.613349 28029 raft_consensus.cc:2368] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
W20260503 07:57:40.664451 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.760680 28033 raft_consensus.cc:2368] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
W20260503 07:57:40.760830 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.701566 28107 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.623385 28106 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
W20260503 07:57:40.674263 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.650650 28105 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
W20260503 07:57:40.726372 28969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s user 0.024s sys 0.064s
W20260503 07:57:40.790444 28969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s user 0.025s sys 0.066s
I20260503 07:57:40.602792 29021 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:40.701705 28986 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:40.798133 27955 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:40.799953 28109 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.800472 29021 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.749629 28104 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.805371 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.813493 28986 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.813898 28109 raft_consensus.cc:1240] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.814004 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.814702 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.815359 28986 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:40.813504 28102 raft_consensus.cc:1240] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.812953 28107 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.825408 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.677220 27956 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:40.813232 28100 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.843463 28027 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:40.849870 28103 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.851289 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.853305 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.861917 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.862536 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.839785 27855 catalog_manager.cc:5671] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 2 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:40.864959 28105 raft_consensus.cc:1240] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.867991 27958 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:40.866997 27855 catalog_manager.cc:5671] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:40.867345 28103 raft_consensus.cc:2368] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:40.877610 27855 catalog_manager.cc:5671] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
W20260503 07:57:40.868606 29031 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
I20260503 07:57:40.882581 27855 catalog_manager.cc:5671] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:40.886195 27855 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:40.901032 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.912431 27855 catalog_manager.cc:5671] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:40.894817 27959 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:40.916843 27855 catalog_manager.cc:5671] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:40.919270 28107 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:40.919528 27855 catalog_manager.cc:5671] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:40.921420 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.922778 27958 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:40.924839 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:40.925765 28105 raft_consensus.cc:2368] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:40.930899 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:40.933293 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:40.934008 27958 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:40.933652 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:40.936834 27958 raft_consensus.cc:1275] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260503 07:57:40.915912 28030 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s user 0.017s sys 0.029s
W20260503 07:57:40.940320 28030 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.707s user 0.018s sys 0.030s
I20260503 07:57:40.940632 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:40.943635 27924 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:40.931049 27855 catalog_manager.cc:5671] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 2 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:40.946226 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:40.992214 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:40.918648 29037 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260503 07:57:40.942847 28964 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:40.941854 28992 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:40.997381 27855 catalog_manager.cc:5671] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
W20260503 07:57:40.993283 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 47101.3us
I20260503 07:57:41.037359 28992 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.037990 28992 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:41.038484 28992 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:40.943159 28978 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:40.999747 29007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s user 0.030s sys 0.051s
W20260503 07:57:41.041323 29007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s user 0.030s sys 0.051s
I20260503 07:57:41.044198 28992 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:41.065699 28107 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:41.085196 29043 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260503 07:57:41.093703 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 348368us
I20260503 07:57:41.098124 29043 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:41.119853 29034 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
W20260503 07:57:41.012027 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 65855us
I20260503 07:57:41.014119 27956 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.124010 29043 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:41.009703 27958 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:40.944737 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:41.015758 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 360749us
I20260503 07:57:40.930337 28619 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:57:41.016616 29041 log.cc:927] Time spent T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
I20260503 07:57:41.021224 28617 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Advancing to term 3
I20260503 07:57:41.031665 28614 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:41.032362 28618 raft_consensus.cc:1240] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
W20260503 07:57:41.128727 27926 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.557s (SENT) [suppressed 2 similar messages]
I20260503 07:57:41.131971 27926 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.035478 28026 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:41.133761 29007 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.135773 28617 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:41.138160 27926 leader_election.cc:400] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:41.139027 27926 leader_election.cc:400] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:41.140381 27926 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.140918 28073 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:41.124027 29034 raft_consensus.cc:697] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:41.150574 27926 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.151650 27999 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.152966 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.158242 27926 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.159655 27926 leader_election.cc:400] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:41.160507 27926 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.169173 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.163779 28985 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.161315 29007 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.161736 28958 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.172070 28978 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.170111 28970 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260503 07:57:41.161319 29052 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.178705 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.180203 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.169641 29043 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:41.181681 29043 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:41.182137 29043 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.183374 29052 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.183248 29044 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:41.181154 28964 consensus_queue.cc:1059] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:41.184386 28964 raft_consensus.cc:3055] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:41.183266 28978 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:41.186028 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.167703 28992 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.194038 27958 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:41.195096 27956 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.186359 28026 raft_consensus.cc:3055] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:41.201161 28026 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:41.201377 28102 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:41.201498 28100 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.201671 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:41.202335 28101 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:41.201834 28026 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:41.201507 28104 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.203029 28026 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.205731 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:41.206384 28103 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.209306 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:41.184803 28964 raft_consensus.cc:740] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:41.212093 28964 consensus_queue.cc:260] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.213323 28985 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.213454 28964 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.188400 29005 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260503 07:57:41.265543 29034 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
W20260503 07:57:41.273046 29051 log.cc:927] Time spent T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.101s user 0.000s sys 0.000s
I20260503 07:57:41.280144 27952 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.281931 29037 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:41.283667 28026 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:41.245777 28966 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:41.285724 28966 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.286127 28972 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:41.287487 28966 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:41.245615 28958 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.266235 28980 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:41.292181 29043 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:41.300158 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 61200.9us
W20260503 07:57:41.301369 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 140946us
I20260503 07:57:41.302579 27926 leader_election.cc:400] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:41.303200 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.304111 27926 leader_election.cc:400] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:41.304735 27926 leader_election.cc:400] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:41.297905 28980 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:41.310482 29026 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:41.330356 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 150207us
I20260503 07:57:41.340605 28980 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:41.341518 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:41.342159 28030 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:57:41.343612 28585 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:41.344420 28957 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:41.338709 29005 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:41.345531 29005 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:41.347173 29005 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:41.333153 28103 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:41.349699 29043 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:41.344779 28957 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:41.350627 28957 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:41.330507 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:41.351945 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.351843 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.364727 29026 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.354833 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:41.365904 27955 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:57:41.366822 27926 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.368603 28978 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:41.369218 29026 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.370873 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.370353 28978 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.354233 29060 consensus_queue.cc:1059] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260503 07:57:41.361049 28964 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.386951 27926 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.392472 28957 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:41.398518 28978 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:41.399307 29026 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.399894 27926 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.412395 28107 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:41.413041 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.422101 27926 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.429476 27955 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.430778 27957 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:41.406625 29034 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.442785 29060 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:41.423427 28958 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:41.420616 28964 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:41.410306 29044 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260503 07:57:41.454241 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:41.428766 28985 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.452925 28107 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:41.454922 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:57:41.460526 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 96915.2us
I20260503 07:57:41.455333 29021 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.456821 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:41.441443 29026 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260503 07:57:41.469112 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 47086.8us
I20260503 07:57:41.458464 28964 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.475366 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.455626 29060 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.461107 29043 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260503 07:57:41.467379 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:41.479115 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.486675 27926 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.487675 27926 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:41.495718 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.496484 27960 raft_consensus.cc:2393] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:41.496986 27957 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260503 07:57:41.497274 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.497851 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.496500 27958 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260503 07:57:41.499951 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.501331 27956 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260503 07:57:41.502447 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.503903 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.504851 27957 raft_consensus.cc:2393] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:41.505681 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.506480 27957 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:41.478120 27952 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.475157 29078 consensus_queue.cc:1059] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260503 07:57:41.510772 28957 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:41.475045 29053 consensus_queue.cc:1059] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260503 07:57:41.470352 28963 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260503 07:57:41.478205 29021 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.515727 27959 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260503 07:57:41.516983 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.466303 29064 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260503 07:57:41.499038 28985 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260503 07:57:41.539140 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 57291.1us
I20260503 07:57:41.503754 28958 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.498747 29034 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:41.521780 27959 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:41.545715 28075 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:41.550539 27960 raft_consensus.cc:2368] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:41.516846 29074 consensus_queue.cc:1059] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260503 07:57:41.539287 28985 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:41.578059 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.547951 28964 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:41.586227 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 164410us
I20260503 07:57:41.550949 28992 raft_consensus.cc:3055] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
W20260503 07:57:41.599555 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:41.600276 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 132328us
I20260503 07:57:41.585803 28985 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:41.598820 28966 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:41.601506 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.606170 29080 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:41.599931 28964 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:41.600592 28992 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:41.611148 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.600798 29078 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:41.619481 27959 raft_consensus.cc:2368] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:41.627542 28075 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:41.609355 27924 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:41.612078 28964 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.629588 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.633878 28075 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:41.631358 29085 consensus_queue.cc:1059] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260503 07:57:41.637411 29073 log.cc:927] Time spent T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.089s user 0.001s sys 0.000s
I20260503 07:57:41.636741 29091 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.638352 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.640358 27955 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:41.641434 27959 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:41.642112 29082 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:41.642159 29005 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:41.643401 28963 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:41.637974 28964 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:41.604507 29052 consensus_queue.cc:1059] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260503 07:57:41.632336 29080 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:41.632563 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:41.653013 28964 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:41.618652 29081 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260503 07:57:41.658957 28964 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.660694 28964 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:41.661412 29052 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:41.644111 29060 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:41.631256 29078 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.668583 29080 raft_consensus.cc:697] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:41.679804 28978 raft_consensus.cc:3055] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:41.680158 28978 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:41.680944 28978 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.678848 29080 consensus_queue.cc:237] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.682958 27957 raft_consensus.cc:1240] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:41.682049 28978 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:41.648916 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.667277 28030 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:57:41.672420 29077 log.cc:927] Time spent T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.149s user 0.001s sys 0.000s
I20260503 07:57:41.676640 28964 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:41.693277 29089 raft_consensus.cc:3055] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:41.705754 29053 raft_consensus.cc:3055] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:41.706113 29053 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:41.707042 29053 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.708474 29053 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:41.713240 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 64845.2us
I20260503 07:57:41.716455 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:41.716971 27951 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:41.697194 28964 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:41.697525 29089 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:41.724264 28964 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:41.725183 27952 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:41.724764 29089 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:41.728399 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 90369.8us
I20260503 07:57:41.729367 27958 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:41.668337 29052 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:41.742036 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 194456us
I20260503 07:57:41.649832 28992 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:41.792487 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.727421 29078 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:41.818996 28964 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.823231 28073 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:41.840041 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.867055 27958 raft_consensus.cc:1275] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.878571 27999 leader_election.cc:400] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:41.857460 28992 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:41.878870 27999 leader_election.cc:403] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:41.865294 29043 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election won for term 2
W20260503 07:57:41.880730 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 239806us
I20260503 07:57:41.824775 27951 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:57:41.884411 28075 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:41.884544 27999 leader_election.cc:400] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:41.826370 28980 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260503 07:57:41.887234 27999 leader_election.cc:403] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:41.826606 29034 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260503 07:57:41.925212 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.888396 28075 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:57:41.928200 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:41.930289 29070 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:41.928820 28075 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:41.894701 28966 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:41.888345 29060 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:41.890446 29043 raft_consensus.cc:697] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:41.890686 29078 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:41.941892 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:41.884132 29074 consensus_queue.cc:1059] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260503 07:57:41.887509 29087 consensus_queue.cc:1059] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260503 07:57:41.887878 29095 consensus_queue.cc:1059] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260503 07:57:41.934034 29089 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:42.009228 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 119451us
W20260503 07:57:42.076164 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 134345us
I20260503 07:57:41.941802 29094 consensus_queue.cc:1059] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.163s
I20260503 07:57:42.089497 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.089725 28027 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:42.089990 28028 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:42.090078 28026 raft_consensus.cc:1275] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:41.942796 28966 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:57:42.025486 29093 log.cc:927] Time spent T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.168s user 0.001s sys 0.000s
W20260503 07:57:42.034956 29062 log.cc:927] Time spent T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.068s user 0.000s sys 0.004s
I20260503 07:57:41.943709 28619 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Advancing to term 2
W20260503 07:57:42.060129 29067 log.cc:927] Time spent T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260503 07:57:42.091810 28075 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:42.092621 28033 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:42.093222 28031 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260503 07:57:42.030630 28030 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:57:42.096801 28031 pending_rounds.cc:85] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 1
I20260503 07:57:42.085762 29044 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.031287 29052 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:42.094019 28035 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:41.997115 29071 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.103338 28075 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:42.094669 28966 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:42.097064 28031 pending_rounds.cc:107] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260503 07:57:42.105983 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:42.106593 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:42.106607 27953 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:42.108465 29005 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:42.110431 28104 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260503 07:57:42.113322 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:42.114830 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.121423 28103 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:42.123930 28103 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:42.126168 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.128208 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:42.130357 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:42.131809 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.131985 28075 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:42.132911 28103 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:42.133240 29081 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:42.134073 29044 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:42.136888 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.139568 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:42.140199 28031 raft_consensus.cc:2889] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:42.044024 28985 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:42.151315 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:42.152340 29104 log.cc:927] Time spent T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260503 07:57:42.153083 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.155670 28964 raft_consensus.cc:3055] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:42.054382 28583 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:57:42.070513 29043 consensus_queue.cc:237] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.103134 29096 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.161707 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:42.180474 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.161932 28964 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.186607 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.187618 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.187104 28964 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:42.188685 28964 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:42.161202 28970 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.189405 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.191114 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:42.200219 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.163848 28028 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:42.203333 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:42.201449 29052 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:42.203117 29071 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.205463 29089 consensus_queue.cc:1059] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:42.201459 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:42.203410 28978 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:42.206374 29037 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:42.221145 29094 raft_consensus.cc:3055] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:42.221258 29037 raft_consensus.cc:697] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:42.221943 29094 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.222420 29037 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:42.222623 29094 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.215272 29052 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.225909 28992 raft_consensus.cc:3055] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:42.226217 29052 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:42.226598 28985 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:42.201682 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 156604us
I20260503 07:57:42.220875 28978 raft_consensus.cc:3055] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:42.229282 28978 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.230044 28978 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:42.220106 29106 log.cc:927] Time spent T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.054s user 0.000s sys 0.001s
I20260503 07:57:42.206192 29053 consensus_queue.cc:1059] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260503 07:57:42.226243 28992 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.244725 29086 raft_consensus.cc:3055] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:42.251574 29086 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.251474 28992 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.252688 28992 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:42.252424 29086 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.268000 28029 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:42.250468 28619 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260503 07:57:42.234001 28966 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:42.269767 28963 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.270043 29086 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:42.271874 29053 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:57:42.291580 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 101089us
W20260503 07:57:42.285794 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 57357.4us
I20260503 07:57:42.302008 29060 raft_consensus.cc:3055] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
W20260503 07:57:42.304975 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 143340us
I20260503 07:57:42.307627 28075 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:42.295574 29088 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260503 07:57:42.304068 29060 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.317292 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33434 (request call id 181) took 2313 ms. Trace:
I20260503 07:57:42.308825 28966 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:42.344376 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 141980us
I20260503 07:57:42.344484 28075 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:42.350383 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:57:42.322496 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 170333us
I20260503 07:57:42.351183 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.291175 29053 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:42.328395 28027 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:42.353863 27999 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.344641 28963 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:42.326558 28026 raft_consensus.cc:1275] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:42.356709 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.357005 28075 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:42.358433 29105 raft_consensus.cc:3055] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:42.358773 29105 raft_consensus.cc:740] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.356101 28964 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:42.359660 29105 consensus_queue.cc:260] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.353747 29044 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.369451 29105 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:42.370824 28970 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:42.371775 28963 raft_consensus.cc:697] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:42.351444 28992 consensus_queue.cc:1059] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260503 07:57:42.379375 29129 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:42.379823 29074 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:42.380236 29074 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.361660 29078 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260503 07:57:42.412725 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:42.449739 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 92787.2us
W20260503 07:57:42.394483 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.368368 29091 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.367549 28964 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260503 07:57:42.500463 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.503710 28106 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:42.500874 29124 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260503 07:57:42.502774 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 54061.8us
I20260503 07:57:42.505543 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:42.504495 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.506858 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.355839 29060 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.510134 29089 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260503 07:57:42.507061 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.434121 29053 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:42.521538 28108 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:42.522045 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:42.526820 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.529479 28109 raft_consensus.cc:2368] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:57:42.537671 27999 leader_election.cc:400] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:42.538609 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.539767 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:42.540298 27960 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:42.545356 29083 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:42.545816 29083 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:42.546538 29127 log.cc:927] Time spent T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.177s user 0.000s sys 0.001s
I20260503 07:57:42.547825 29083 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:42.545077 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.543923 28075 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:42.558702 27960 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:42.345654 27854 rpcz_store.cc:276] 0503 07:57:40.003623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:40.003762 (+ 139us) service_pool.cc:224] Handling call
0503 07:57:40.030062 (+ 26300us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5400041354. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468e470 00007f850472d31a 00007f850a4d046c 00007f850a5ca3ee 00007f8508ab04a4 00007f8508ab0432 00007f8508ab0361 00007f8508ab02dc 00007f8508aaf592 00007f8502a5ebcc 00007f8502a5e006
0503 07:57:42.317194 (+2287132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:57:40.759836 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:57:40.893328 (+133492us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:57:40.894115 (+ 787us) write_op.cc:435] Acquired schema lock
0503 07:57:40.912081 (+ 17966us) tablet.cc:662] Decoding operations
0503 07:57:40.947343 (+ 35262us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:57:40.994945 (+ 47602us) write_op.cc:641] Partition lock acquired for write op
0503 07:57:41.001295 (+ 6350us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:57:41.035869 (+ 34574us) tablet.cc:701] Row locks acquired
0503 07:57:41.035894 (+ 25us) write_op.cc:260] PREPARE: finished
0503 07:57:41.036029 (+ 135us) write_op.cc:270] Start()
0503 07:57:41.036149 (+ 120us) write_op.cc:276] Timestamp: P: 1777795061035993 usec, L: 0
0503 07:57:41.036173 (+ 24us) op_driver.cc:348] REPLICATION: starting
0503 07:57:41.042553 (+ 6380us) log.cc:844] Serialized 529 byte log entry
0503 07:57:41.455584 (+413031us) op_driver.cc:464] REPLICATION: finished
0503 07:57:41.736056 (+280472us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f850166982c 00007f850a462bc9 00007f8501685cdb 00007f8501683f7f 00007f8501686242 00007f8508166360
0503 07:57:42.001684 (+265628us) write_op.cc:301] APPLY: starting
0503 07:57:42.013441 (+ 11757us) tablet.cc:1367] starting BulkCheckPresence
0503 07:57:42.040006 (+ 26565us) tablet.cc:1370] finished BulkCheckPresence
0503 07:57:42.041502 (+ 1496us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:57:42.055197 (+ 13695us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:57:42.061427 (+ 6230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:57:42.070258 (+ 8831us) write_op.cc:312] APPLY: finished
0503 07:57:42.071524 (+ 1266us) log.cc:844] Serialized 22 byte log entry
0503 07:57:42.071999 (+ 475us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:42.072059 (+ 60us) write_op.cc:454] Released schema lock
0503 07:57:42.085696 (+ 13637us) write_op.cc:341] FINISH: Updating metrics
0503 07:57:42.103897 (+ 18201us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:42.105150 (+ 1253us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":50346880,"child_traces":[["op",{"apply.queue_time_us":481264,"apply.run_cpu_time_us":2353,"apply.run_wall_time_us":117670,"num_ops":1,"prepare.queue_time_us":527564,"prepare.run_cpu_time_us":20351,"prepare.run_wall_time_us":414775,"raft.queue_time_us":655904,"raft.run_cpu_time_us":78352,"raft.run_wall_time_us":686215,"replication_time_us":405776,"spinlock_wait_cycles":10831232,"thread_start_us":849993,"threads_started":4,"wal-append.queue_time_us":186594}]]}
I20260503 07:57:42.559437 29086 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:42.529615 29060 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:42.571736 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.519865 28992 consensus_queue.cc:1059] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260503 07:57:42.574095 27999 leader_election.cc:400] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:42.379828 29129 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:42.574463 27999 leader_election.cc:403] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260503 07:57:42.568352 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.578058 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:42.579784 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 58081.5us
I20260503 07:57:42.567317 29105 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:42.381042 29074 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.575481 29086 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.579263 29053 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:42.597383 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.597987 28031 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:42.590060 29089 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:42.584424 28992 consensus_queue.cc:1243] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:42.600085 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.601120 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.584587 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:42.609810 28033 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:42.600978 28031 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:42.567845 28963 consensus_queue.cc:237] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.581526 28964 consensus_queue.cc:1059] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260503 07:57:42.620858 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.649915 28033 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:42.601909 29074 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:42.653330 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.655520 28035 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:42.655728 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.653435 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.594125 29123 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.654057 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.659226 28032 raft_consensus.cc:2368] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:42.656433 28034 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:42.656288 28033 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:42.604454 29124 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260503 07:57:42.663287 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.614108 29089 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:42.598899 29034 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260503 07:57:42.660809 27953 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:42.653221 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.599687 29005 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260503 07:57:42.664815 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.666246 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.670282 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.670957 28035 raft_consensus.cc:2368] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:57:42.672188 28033 raft_consensus.cc:2368] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:42.673316 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.674288 28035 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:42.675609 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:42.679688 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:42.703404 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.719667 28032 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260503 07:57:42.740245 29131 log.cc:927] Time spent T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.085s user 0.000s sys 0.000s
I20260503 07:57:42.740180 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.741407 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.670991 28034 raft_consensus.cc:2376] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3. Re-sending same reply.
I20260503 07:57:42.741746 29122 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.150s
I20260503 07:57:42.742538 28033 raft_consensus.cc:2410] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260503 07:57:42.748838 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.669389 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.750736 29090 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:42.751220 29090 raft_consensus.cc:697] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:42.750707 28026 raft_consensus.cc:2376] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3. Re-sending same reply.
W20260503 07:57:42.749641 29108 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260503 07:57:42.751993 29090 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:42.742283 28032 raft_consensus.cc:2368] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:42.668985 29089 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:42.761263 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.767799 28035 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:42.773859 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.774677 28035 raft_consensus.cc:2368] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:42.769469 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:42.782366 29107 log.cc:927] Time spent T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260503 07:57:42.788431 28104 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
W20260503 07:57:42.792049 29132 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.139s user 0.001s sys 0.000s
I20260503 07:57:42.792099 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.792454 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:42.793583 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:42.793816 28100 raft_consensus.cc:1240] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:42.794775 28035 raft_consensus.cc:2376] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3. Re-sending same reply.
W20260503 07:57:42.796026 29137 log.cc:927] Time spent T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.174s user 0.000s sys 0.000s
I20260503 07:57:42.798087 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.802621 28035 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:42.803803 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.805401 29129 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:42.805316 28035 raft_consensus.cc:2368] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:57:42.810273 28035 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260503 07:57:42.819700 28035 pending_rounds.cc:85] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 2
I20260503 07:57:42.821967 28035 pending_rounds.cc:107] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260503 07:57:42.814419 28992 raft_consensus.cc:3055] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:42.812484 28033 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:42.807459 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:42.839160 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:42.823997 28035 raft_consensus.cc:2917] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260503 07:57:42.844319 28035 raft_consensus.cc:2889] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:42.833570 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:42.848186 28033 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:42.850911 28033 raft_consensus.cc:3055] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:42.852932 28033 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.866181 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.832860 28992 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:42.863418 28033 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.891937 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.919564 28035 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:57:42.920607 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:42.894083 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 320715us
I20260503 07:57:42.922806 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:42.844237 28964 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.947007 28073 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:42.949589 29121 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:42.950177 29121 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:42.952605 29121 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:42.925961 29123 consensus_queue.cc:1059] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260503 07:57:42.983044 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 401456us
I20260503 07:57:42.923509 28978 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:42.922477 29053 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.924496 29105 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:42.925858 29086 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:42.965297 28952 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:42.925441 28585 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:42.953835 28964 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.003391 29151 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.009857 29151 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:43.012188 29151 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.015618 27954 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:43.009119 27924 leader_election.cc:400] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:57:43.017534 27924 leader_election.cc:403] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260503 07:57:43.019286 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 429595us
W20260503 07:57:43.020341 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.018244 29151 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.018725 29125 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:43.003437 29053 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:43.017499 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 127608us
I20260503 07:57:43.023419 28952 raft_consensus.cc:697] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:43.024839 29007 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:57:43.021620 29121 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:43.015386 28964 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:43.003297 28992 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:43.063755 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 141034us
I20260503 07:57:43.064821 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.066234 27999 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.049480 29125 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:57:43.075877 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.061895 29088 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:43.070902 29105 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:43.054586 29151 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:43.081064 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 407595us
I20260503 07:57:43.070693 29125 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:43.074431 29086 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:43.060330 29089 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.062309 29121 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.164898 27926 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:43.166518 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 83901.3us
W20260503 07:57:43.167637 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 86580.7us
W20260503 07:57:43.167973 29119 log.cc:927] Time spent T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260503 07:57:43.160892 28985 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:57:43.197798 29060 consensus_meta.cc:287] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.624s user 0.007s sys 0.002s
W20260503 07:57:43.223405 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 55074.7us
I20260503 07:57:43.218940 28985 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.217293 29071 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260503 07:57:43.192601 29080 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:43.226397 29158 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:57:43.232261 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 50036.5us
I20260503 07:57:43.219514 29141 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260503 07:57:43.251582 28029 raft_consensus.cc:2410] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260503 07:57:43.224016 29122 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260503 07:57:43.163955 29088 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.219213 29053 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.193877 29037 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260503 07:57:43.265403 29053 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.267865 29053 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.268895 29100 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260503 07:57:43.277281 29139 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:43.277964 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:43.278223 29100 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:43.217988 28952 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:43.272537 28035 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:43.273479 29151 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.274487 27959 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:57:43.253677 29007 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:43.256852 29060 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:57:43.290269 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 104538us
I20260503 07:57:43.290922 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.295454 27926 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.289124 29007 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.259814 29080 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.293291 29151 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:43.280815 28963 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260503 07:57:43.294734 28964 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.305796 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.307407 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.308102 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.303018 29007 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.309363 28107 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:43.319597 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.320431 29082 raft_consensus.cc:1064] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:43.320626 28026 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:43.323632 27954 raft_consensus.cc:1275] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260503 07:57:43.324805 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:43.325172 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.320007 29125 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:43.295403 29044 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260503 07:57:43.293201 29060 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:43.263824 29158 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.329914 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.344766 28618 raft_consensus.cc:2393] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
W20260503 07:57:43.346472 29144 log.cc:927] Time spent T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.242s user 0.001s sys 0.000s
I20260503 07:57:43.331369 29053 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.331030 28964 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.328662 29129 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260503 07:57:43.332283 29123 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.335304 29089 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.323658 29151 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:43.359663 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 64275.3us
I20260503 07:57:43.322576 29082 consensus_queue.cc:237] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:57:43.364018 29143 log.cc:927] Time spent T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.114s user 0.000s sys 0.000s
I20260503 07:57:43.362349 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.347599 29121 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.365746 27926 leader_election.cc:400] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
W20260503 07:57:43.366644 29150 log.cc:927] Time spent T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.112s user 0.000s sys 0.001s
I20260503 07:57:43.366971 28985 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.367369 29167 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:43.371404 29140 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260503 07:57:43.377032 29167 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:43.377437 29167 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.355036 29053 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.379405 29053 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.368414 29088 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.367754 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.358345 28964 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.368920 28108 raft_consensus.cc:2393] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:43.370047 29162 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:43.369248 27926 leader_election.cc:403] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:57:43.376333 27956 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260503 07:57:43.429121 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 56358.5us
W20260503 07:57:43.430835 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 67020.3us
I20260503 07:57:43.431514 27926 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.437836 27926 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:43.439016 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:43.439513 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:43.444701 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.445297 27924 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:43.360641 29123 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.431392 29053 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.464569 27926 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:43.431468 29162 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.433032 28026 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:43.467700 29121 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:43.470659 29060 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:43.471030 29166 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:43.446324 28985 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:43.462860 28614 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260503 07:57:43.478919 29123 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.480046 29125 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.468336 29162 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.481074 28964 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.470573 29080 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.463341 29071 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260503 07:57:43.481762 29074 consensus_meta.cc:287] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.822s user 0.011s sys 0.000s
I20260503 07:57:43.475855 29088 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260503 07:57:43.488569 29130 log.cc:927] Time spent T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.753s user 0.000s sys 0.017s
I20260503 07:57:43.481218 28985 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.468569 29053 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.505887 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.505734 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.509279 28026 raft_consensus.cc:2393] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:43.511266 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.511920 28031 raft_consensus.cc:2393] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:43.500993 29088 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:43.510989 29151 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.523031 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.523715 29007 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:43.524953 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.525141 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.525998 28027 raft_consensus.cc:2410] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260503 07:57:43.529664 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.530215 28034 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:43.531034 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.531538 28034 raft_consensus.cc:2376] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2. Re-sending same reply.
I20260503 07:57:43.523723 28031 raft_consensus.cc:2393] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:43.531853 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.532305 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.532661 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.532791 28029 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:43.533349 28031 raft_consensus.cc:2393] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:43.533782 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.534041 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.535348 29007 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.535861 29053 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.534350 28029 raft_consensus.cc:2376] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3. Re-sending same reply.
I20260503 07:57:43.538036 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:43.539382 29149 log.cc:927] Time spent T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.464s user 0.001s sys 0.000s
I20260503 07:57:43.540340 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.541077 28029 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:43.486291 29163 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.206s
I20260503 07:57:43.542126 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.543898 28029 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:43.561816 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.562808 28029 raft_consensus.cc:1275] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:43.563942 28029 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:43.546538 29053 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.538879 29088 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:57:43.549165 29161 log.cc:927] Time spent T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260503 07:57:43.549865 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.588065 28032 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:43.508010 28985 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.589855 29094 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.555327 28103 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:43.556706 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.512966 29158 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.557580 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:43.557839 29134 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.727s user 0.003s sys 0.011s
I20260503 07:57:43.559999 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.560375 28101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 479) took 1039 ms. Trace:
I20260503 07:57:43.560588 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.561204 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.565187 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.543537 29173 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:43.532873 28034 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:43.577507 29159 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.548275 29167 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.578022 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.577401 29053 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.584669 28028 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:43.535962 28031 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:43.593912 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.600309 28109 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
W20260503 07:57:43.605696 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 120558us
I20260503 07:57:43.608326 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:43.609719 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 452) took 1013 ms. Trace:
I20260503 07:57:43.610009 29167 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.610111 28028 rpcz_store.cc:276] 0503 07:57:42.596612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:42.598032 (+ 1420us) service_pool.cc:224] Handling call
0503 07:57:43.584025 (+985993us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b5800002498. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649a3e 000000000035a3c9 00007f85096818e0 00007f850974a784 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:57:43.584156 (+ 131us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:43.607708 (+ 23552us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:43.609672 (+ 1964us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19188096}
I20260503 07:57:43.607944 29162 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.611227 28031 raft_consensus.cc:1240] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:43.612313 29162 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.622462 28032 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:43.606262 29173 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:43.626807 29158 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:43.624300 29167 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.651994 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.615722 29159 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.628500 28619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51194 (request call id 60) took 1223 ms. Trace:
W20260503 07:57:43.654084 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.638710 29173 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.653411 29158 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:43.647132 29053 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.649459 29081 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:57:43.683398 29108 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260503 07:57:43.686789 29158 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:43.692798 28075 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:43.684809 28102 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:43.649107 29154 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.683596 28964 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:57:43.716528 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 251988us
I20260503 07:57:43.717717 27926 leader_election.cc:400] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:57:43.718143 27926 leader_election.cc:403] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260503 07:57:43.719338 27926 leader_election.cc:400] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:43.708930 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:43.719861 27926 leader_election.cc:403] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:43.720446 29053 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:43.720893 29053 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:43.721205 29178 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:43.721412 29053 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:43.723681 29178 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:43.725699 27926 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.681649 29167 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.731606 27926 leader_election.cc:400] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:43.732332 27926 leader_election.cc:403] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:43.704553 28970 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:43.740913 27926 leader_election.cc:400] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:43.741214 27926 leader_election.cc:403] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:43.732030 29080 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:43.728940 29026 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
W20260503 07:57:43.745489 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 49600us
I20260503 07:57:43.747658 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:43.744100 28031 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:43.750365 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.599834 28101 rpcz_store.cc:276] 0503 07:57:42.520617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:42.523263 (+ 2646us) service_pool.cc:224] Handling call
0503 07:57:42.546315 (+ 23052us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:42.570547 (+ 24232us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:42.570591 (+ 44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:43.314155 (+743564us) spinlock_profiling.cc:243] Waited 972 us on lock 0x7b180033ad20. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686b62 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:43.333826 (+ 19671us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b2c00104df8. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850301ec81 00007f850302e5e2 00007f850475fde1 00007f850472481a 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22
0503 07:57:43.367063 (+ 33237us) log.cc:844] Serialized 26 byte log entry
0503 07:57:43.439915 (+ 72852us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:43.446066 (+ 6151us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:43.464147 (+ 18081us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:43.560178 (+ 96031us) raft_consensus.cc:1685] finished
0503 07:57:43.560196 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:43.560323 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26992,"raft.queue_time_us":24780,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5562,"spinlock_wait_cycles":6331392,"thread_start_us":64156,"threads_started":1,"wal-append.queue_time_us":154420}
I20260503 07:57:43.726567 28964 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.754123 28075 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:43.704439 29081 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.797693 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:43.751978 28970 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:43.756470 27926 leader_election.cc:400] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:57:43.801458 29164 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:43.798478 29071 raft_consensus.cc:2764] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260503 07:57:43.805166 29170 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
W20260503 07:57:43.805563 29181 log.cc:927] Time spent T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260503 07:57:43.730671 29154 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.753729 29090 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260503 07:57:43.801118 27926 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.827085 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.828517 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.783514 29080 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260503 07:57:43.798501 29177 log.cc:927] Time spent T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.185s user 0.001s sys 0.000s
I20260503 07:57:43.829175 28032 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:43.805879 29180 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:43.752363 29141 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260503 07:57:43.832088 27926 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.807466 28966 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:43.866736 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.832209 29163 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260503 07:57:43.830430 29184 log.cc:927] Time spent T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
I20260503 07:57:43.868974 27958 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:43.872051 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:43.872328 28030 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:43.868742 29163 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.872807 29183 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:43.871307 28032 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:57:43.871218 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:43.872615 28102 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:43.870858 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.875227 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.874243 27954 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:43.873171 29163 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.879046 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.830716 29080 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.832832 29078 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.859921 29159 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.867115 29178 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:43.884603 29167 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.884799 28585 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:43.867166 28966 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:57:43.893121 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.829210 29100 consensus_queue.cc:1059] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260503 07:57:43.894164 27955 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:43.874593 29123 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.890398 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.896219 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.892520 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.897356 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.897866 27960 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:43.898574 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.899111 27959 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:43.868577 29007 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260503 07:57:43.900940 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.884265 29080 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.894935 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.903445 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:43.886538 28978 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:43.904201 27958 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:43.679184 28619 rpcz_store.cc:276] 0503 07:57:42.404643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:42.405002 (+ 359us) service_pool.cc:224] Handling call
0503 07:57:42.405356 (+ 354us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:42.405754 (+ 398us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:42.405830 (+ 76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:42.432991 (+ 27161us) log.cc:844] Serialized 26 byte log entry
0503 07:57:42.573663 (+140672us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:42.576338 (+ 2675us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:42.581887 (+ 5549us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:43.509592 (+927705us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b2400301a48. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85014d8e94 00007f85014d6f9b 00007f8501565d39 00007f85015659c5 00007f850156500d 00007f85042a74ae 00007f85042bec2c 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1
0503 07:57:43.628176 (+118584us) raft_consensus.cc:1685] finished
0503 07:57:43.628202 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:43.628430 (+ 228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20379,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6022,"spinlock_wait_cycles":4551040,"thread_start_us":72999,"threads_started":1,"wal-append.queue_time_us":218405}
I20260503 07:57:43.903503 27955 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:43.895006 28966 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:43.903867 29159 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:43.954110 29124 raft_consensus.cc:3055] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:43.954461 29124 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:43.955231 29124 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.956692 29124 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.959738 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.960744 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.961447 29154 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.961555 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.962069 28035 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.966650 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.967181 28034 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:43.967875 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.968382 28034 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:43.969058 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.969862 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:43.970520 29088 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.972661 29088 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.907792 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.973869 28028 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:43.974685 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.902964 29123 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.908156 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33288 (request call id 472) took 1243 ms. Trace:
I20260503 07:57:43.975567 28027 rpcz_store.cc:276] 0503 07:57:42.664302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:42.739767 (+ 75465us) service_pool.cc:224] Handling call
0503 07:57:43.907941 (+1168174us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b540029b3d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:43.908078 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749090048}
I20260503 07:57:43.976359 27959 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:43.976657 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:43.978156 28034 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:43.906859 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:43.978945 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 72127.7us
I20260503 07:57:43.979624 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:43.920593 29188 log.cc:927] Time spent T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260503 07:57:43.980990 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:43.921453 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:43.982005 27999 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:43.913249 29060 consensus_queue.cc:1059] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260503 07:57:43.935887 29168 log.cc:927] Time spent T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.623s user 0.000s sys 0.003s
I20260503 07:57:43.938517 28992 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:43.945258 29053 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.913647 27951 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260503 07:57:43.905050 28980 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:43.949416 28614 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Advancing to term 4
I20260503 07:57:43.950256 28964 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:43.951216 29081 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:43.915908 29182 log.cc:927] Time spent T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.181s user 0.000s sys 0.001s
I20260503 07:57:43.973260 27957 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:43.909795 27857 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 3 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:43.976820 27960 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:43.911854 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 179) took 3121 ms. Trace:
I20260503 07:57:43.888970 29178 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:43.916195 28978 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.888072 29078 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.003391 28035 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:43.985571 29159 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:43.982183 29158 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:43.993877 29074 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.066095 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.072155 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.072432 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.073161 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.073774 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.074316 28106 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.074688 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.078824 27960 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:44.072461 28952 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.069291 29081 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.081391 28028 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:44.026546 29178 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.022959 27855 rpcz_store.cc:276] 0503 07:57:40.790023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:40.800119 (+ 10096us) service_pool.cc:224] Handling call
0503 07:57:43.911801 (+3111682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:57:41.165085 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:57:41.173211 (+ 8126us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:57:41.173239 (+ 28us) write_op.cc:435] Acquired schema lock
0503 07:57:41.173254 (+ 15us) tablet.cc:662] Decoding operations
0503 07:57:41.174177 (+ 923us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:57:41.174223 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0503 07:57:41.174247 (+ 24us) tablet.cc:685] Acquiring locks for 10 operations
0503 07:57:41.174930 (+ 683us) tablet.cc:701] Row locks acquired
0503 07:57:41.174949 (+ 19us) write_op.cc:260] PREPARE: finished
0503 07:57:41.175060 (+ 111us) write_op.cc:270] Start()
0503 07:57:41.175174 (+ 114us) write_op.cc:276] Timestamp: P: 1777795061175022 usec, L: 0
0503 07:57:41.175192 (+ 18us) op_driver.cc:348] REPLICATION: starting
0503 07:57:41.175997 (+ 805us) log.cc:844] Serialized 4025 byte log entry
0503 07:57:41.932527 (+756530us) op_driver.cc:464] REPLICATION: finished
0503 07:57:42.110251 (+177724us) write_op.cc:301] APPLY: starting
0503 07:57:42.110333 (+ 82us) tablet.cc:1367] starting BulkCheckPresence
0503 07:57:42.110582 (+ 249us) tablet.cc:1370] finished BulkCheckPresence
0503 07:57:42.110711 (+ 129us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:57:42.111859 (+ 1148us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:57:42.112033 (+ 174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0503 07:57:42.112081 (+ 48us) write_op.cc:312] APPLY: finished
0503 07:57:42.113202 (+ 1121us) log.cc:844] Serialized 76 byte log entry
0503 07:57:42.113325 (+ 123us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:42.113422 (+ 97us) write_op.cc:454] Released schema lock
0503 07:57:42.113459 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0503 07:57:42.113764 (+ 305us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:42.113793 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":205130,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":168194,"apply.run_cpu_time_us":2585,"apply.run_wall_time_us":3464,"num_ops":10,"prepare.queue_time_us":62572,"prepare.run_cpu_time_us":3293,"prepare.run_wall_time_us":11138,"replication_time_us":715408,"thread_start_us":134997,"threads_started":1}]]}
I20260503 07:57:44.011742 29157 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260503 07:57:44.083257 27926 leader_election.cc:336] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.866s (SENT)
I20260503 07:57:44.028554 29159 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.026831 28980 raft_consensus.cc:697] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:44.071492 28964 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.028218 29080 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.087078 27926 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:44.087811 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 105889us
I20260503 07:57:44.100009 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:44.100914 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.102109 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.087215 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.103277 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:44.104315 28027 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:44.086104 29088 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.097121 29159 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.095233 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.114831 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.116431 27926 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.119613 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:44.120489 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:44.120489 27926 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:44.120887 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:44.121866 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:44.122368 28106 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:44.085892 28952 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.089150 29081 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:44.117748 28985 consensus_meta.cc:287] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.528s user 0.009s sys 0.001s
I20260503 07:57:44.125299 29167 raft_consensus.cc:1064] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:44.124696 27926 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:44.113432 29157 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.114639 29170 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:44.124322 29060 consensus_queue.cc:1243] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:44.123363 29183 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:44.124605 29164 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:44.124855 29180 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:44.126724 29121 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:44.126603 28964 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:44.133430 28102 raft_consensus.cc:2393] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:44.141181 28109 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:44.138384 28100 raft_consensus.cc:2393] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:44.117628 29088 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.139513 29007 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:44.140132 29183 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:44.134047 29140 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260503 07:57:44.142298 29164 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:44.140631 29196 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:44.158557 29201 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:44.171350 29201 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:44.171657 29201 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.172851 29123 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.164458 29183 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.138258 29157 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.136252 28985 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.148308 29082 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.149098 28964 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:44.150403 29100 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:44.168679 29196 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.170962 29199 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.144770 29180 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:44.152751 29053 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.151844 29121 raft_consensus.cc:697] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:44.162101 28978 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.186201 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.167187 29078 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.174481 29158 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.169708 29164 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.143345 28980 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:44.223978 27960 raft_consensus.cc:1240] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
W20260503 07:57:44.236429 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 50298.2us
I20260503 07:57:44.187134 28964 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.233124 29007 raft_consensus.cc:697] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:44.191821 29196 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.174811 29198 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:44.236827 29053 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.181071 29111 consensus_queue.cc:1059] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260503 07:57:44.258522 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:44.270905 27956 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:44.195281 29180 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.252352 28030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 454) took 1652 ms. Trace:
W20260503 07:57:44.245713 29173 consensus_meta.cc:287] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.548s user 0.006s sys 0.004s
I20260503 07:57:44.221181 29080 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.192581 29082 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.249318 29078 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.254326 29070 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:44.192416 29100 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:44.306486 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.306726 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.308422 28109 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:57:44.287164 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:44.274312 28952 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:44.309772 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.194936 29199 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.310141 29078 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
W20260503 07:57:44.323320 29204 log.cc:927] Time spent T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
I20260503 07:57:44.324249 29078 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.322568 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.304919 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.275558 29081 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.261159 29205 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260503 07:57:44.354211 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 103628us
I20260503 07:57:44.310683 29070 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.359980 29007 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.370286 29070 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:44.357699 29199 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.270133 29198 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:44.272670 29053 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.314530 29005 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.361279 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.361981 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.275044 29141 consensus_queue.cc:1059] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260503 07:57:44.328363 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.350937 29088 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.375129 29082 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:44.375800 29199 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.272311 28030 rpcz_store.cc:276] 0503 07:57:42.599687 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:42.602427 (+ 2740us) service_pool.cc:224] Handling call
0503 07:57:43.322248 (+719821us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b5800002498. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:57:43.326363 (+ 4115us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:43.872787 (+546424us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.245149 (+372362us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400353ed4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:57:44.252255 (+ 7106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274471680}
I20260503 07:57:44.276283 29173 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.376328 28100 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:44.309728 29121 consensus_queue.cc:237] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.387394 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.387467 27956 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:44.389606 29074 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:44.395534 29074 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:44.396020 28966 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.379941 28985 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.392977 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:44.394990 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:44.390782 29198 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:44.402715 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.320519 29210 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
W20260503 07:57:44.397425 29207 log.cc:927] Time spent T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.092s user 0.000s sys 0.000s
I20260503 07:57:44.398347 29205 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.392319 29060 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.380261 29005 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.400277 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.409603 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:44.386198 29199 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.401907 28978 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:44.413529 28102 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:44.403016 28966 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:44.415586 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:44.439409 27957 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:44.440088 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.440296 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.393990 29088 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260503 07:57:44.417371 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.381829 29178 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.427093 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:44.407146 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.443596 27951 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:44.418790 29157 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.444449 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.444648 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.448374 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.449355 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:44.449841 27955 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:44.450208 29178 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.451335 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.429322 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:44.434252 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.386911 29163 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:44.415302 29074 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:44.441161 29139 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260503 07:57:44.443007 28100 raft_consensus.cc:2410] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260503 07:57:44.380213 29167 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:44.445493 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.446866 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:44.449595 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.467125 29178 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.473595 29199 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.465305 28614 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 4 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:44.453541 28992 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:44.453212 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.491649 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:44.463806 29005 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:44.459144 29053 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.442248 27999 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:44.463397 27956 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
W20260503 07:57:44.526963 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 84755.7us
I20260503 07:57:44.465730 27924 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:44.528899 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 63266.1us
I20260503 07:57:44.460978 29183 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.433056 29159 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.471470 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.472513 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:44.477332 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 906) took 1155 ms. Trace:
I20260503 07:57:44.465240 28964 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.434029 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.485694 27954 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:44.486122 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.533322 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.531898 28031 rpcz_store.cc:276] 0503 07:57:43.322021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:43.981743 (+659722us) service_pool.cc:224] Handling call
0503 07:57:43.981986 (+ 243us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.082565 (+100579us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.082592 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.087279 (+ 4687us) log.cc:844] Serialized 26 byte log entry
0503 07:57:44.354582 (+267303us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:44.379418 (+ 24836us) log.cc:844] Serialized 14 byte log entry
0503 07:57:44.381187 (+ 1769us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.381257 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:44.477092 (+ 95835us) raft_consensus.cc:1685] finished
0503 07:57:44.477120 (+ 28us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:44.477268 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1447,"prepare.queue_time_us":24343,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2530,"raft.queue_time_us":32978,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":23733,"thread_start_us":338612,"threads_started":2,"wal-append.queue_time_us":294790}
I20260503 07:57:44.535104 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.535213 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:44.536062 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.536257 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:44.489913 28966 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.490041 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 908) took 1167 ms. Trace:
I20260503 07:57:44.457231 29100 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:44.452273 28978 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:44.537755 28030 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:44.540036 28978 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.515753 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.549289 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.467032 29078 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:44.550190 27959 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:44.550257 29163 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.465121 29201 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.550405 29078 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:44.550992 29196 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.551973 29201 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.552343 29078 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:44.529888 27924 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.552700 29196 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.558180 29159 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.533264 27926 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.518689 28026 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:44.490049 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.531441 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.486799 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.529407 29026 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.457851 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.542752 27953 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:44.538021 28035 rpcz_store.cc:276] 0503 07:57:43.322463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.024538 (+702075us) service_pool.cc:224] Handling call
0503 07:57:44.024875 (+ 337us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.376873 (+351998us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.376911 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.377307 (+ 396us) log.cc:844] Serialized 26 byte log entry
0503 07:57:44.390151 (+ 12844us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:44.390869 (+ 718us) log.cc:844] Serialized 14 byte log entry
0503 07:57:44.391027 (+ 158us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.391180 (+ 153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:44.488254 (+ 97074us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b18002e6720. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:44.489748 (+ 1494us) raft_consensus.cc:1685] finished
0503 07:57:44.489857 (+ 109us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:44.489980 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10310,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":83511,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":6028,"spinlock_wait_cycles":6714624,"thread_start_us":352517,"threads_started":3,"wal-append.queue_time_us":31497}
I20260503 07:57:44.596007 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:44.597209 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:44.529177 29124 consensus_queue.cc:1059] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260503 07:57:44.604104 29124 raft_consensus.cc:3055] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:44.604395 29124 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:44.604743 28027 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260503 07:57:44.531438 29208 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.463538 28109 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:44.554594 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:44.553670 27924 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:44.617376 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 63774.2us
I20260503 07:57:44.451551 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 907) took 1129 ms. Trace:
I20260503 07:57:44.618413 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.619829 27958 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:44.554911 29164 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.556182 29007 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.529063 29053 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.627771 29154 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:44.627885 27952 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:44.628262 29154 raft_consensus.cc:697] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:44.578384 28985 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.538264 27951 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:44.523459 28992 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.538172 28619 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:44.550184 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.538064 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:44.571521 27955 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:44.573323 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:44.571120 29192 log.cc:927] Time spent T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.438s user 0.003s sys 0.002s
I20260503 07:57:44.541286 28966 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.583949 28028 raft_consensus.cc:2393] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:44.585963 28978 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.565824 29173 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.588766 29180 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.602028 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.638367 28073 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:44.602522 28964 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.603158 29179 raft_consensus.cc:3055] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:44.605063 29124 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.533896 29005 consensus_queue.cc:1059] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260503 07:57:44.623925 28031 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:44.618884 28034 rpcz_store.cc:276] 0503 07:57:43.322243 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:43.984425 (+662182us) service_pool.cc:224] Handling call
0503 07:57:43.984746 (+ 321us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.114919 (+130173us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.114945 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.122843 (+ 7898us) log.cc:844] Serialized 26 byte log entry
0503 07:57:44.150780 (+ 27937us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:44.156173 (+ 5393us) log.cc:844] Serialized 14 byte log entry
0503 07:57:44.175195 (+ 19022us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.175303 (+ 108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:44.451330 (+276027us) raft_consensus.cc:1685] finished
0503 07:57:44.451355 (+ 25us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:44.451489 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18604,"prepare.queue_time_us":4869,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":104358,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":17910,"thread_start_us":151387,"threads_started":2,"wal-append.queue_time_us":112575}
I20260503 07:57:44.626012 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 910) took 1250 ms. Trace:
I20260503 07:57:44.627436 29164 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.538158 29199 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.575052 29043 consensus_queue.cc:1059] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260503 07:57:44.563742 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:44.629781 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 103646us
W20260503 07:57:44.634357 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 61096.1us
I20260503 07:57:44.584908 29183 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.605993 29026 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.653657 29124 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.653925 29064 raft_consensus.cc:3055] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:44.654304 29064 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:57:44.654883 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 91195.4us
I20260503 07:57:44.644863 28027 rpcz_store.cc:276] 0503 07:57:43.375104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.604204 (+1229100us) service_pool.cc:224] Handling call
0503 07:57:44.604462 (+ 258us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:44.616088 (+ 11626us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.625946 (+ 9858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:57:44.655591 29180 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.637638 29208 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:44.648594 28034 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:44.641283 29179 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:44.651212 27924 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.641289 28978 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.634496 28992 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.644104 28035 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:44.655483 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.648986 28103 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:44.644747 29111 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:44.659296 29208 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:44.662179 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:44.662789 28034 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:44.663323 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.644836 29100 consensus_queue.cc:1059] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260503 07:57:44.664502 27924 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.670784 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.665808 28966 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:44.666163 29005 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:44.663929 29199 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:44.655289 29026 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.668843 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 905) took 1347 ms. Trace:
I20260503 07:57:44.658826 29159 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:44.671836 27958 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:44.671998 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.655277 29064 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.673326 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.674290 28106 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260503 07:57:44.676446 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.661103 27951 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:44.678422 27999 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.679358 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.679620 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.724918 28107 raft_consensus.cc:2393] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:44.660378 29179 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.675055 29139 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.681077 28970 consensus_queue.cc:1059] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260503 07:57:44.684108 29196 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.681777 28032 rpcz_store.cc:276] 0503 07:57:43.321744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:43.878944 (+557200us) service_pool.cc:224] Handling call
0503 07:57:43.879217 (+ 273us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:43.883174 (+ 3957us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:43.883204 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:43.884595 (+ 1391us) log.cc:844] Serialized 26 byte log entry
0503 07:57:43.984000 (+ 99405us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:44.021659 (+ 37659us) log.cc:844] Serialized 14 byte log entry
0503 07:57:44.021852 (+ 193us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.021941 (+ 89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:44.323672 (+301731us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b180010c240. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686b62 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:44.558703 (+235031us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f85042bec0e 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1 00007f85042c7579 00007f85042c7509
0503 07:57:44.668710 (+110007us) raft_consensus.cc:1685] finished
0503 07:57:44.668724 (+ 14us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:44.668805 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1021,"prepare.queue_time_us":27999,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":72868,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":12387,"spinlock_wait_cycles":11521664,"thread_start_us":99054,"threads_started":1,"wal-append.queue_time_us":220155}
I20260503 07:57:44.684296 29100 raft_consensus.cc:3055] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:44.684844 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.685252 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.685850 28978 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.685772 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.686887 28992 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.687255 28033 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.656561 29154 consensus_queue.cc:237] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.723505 27956 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:44.669274 29111 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:44.675172 29208 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.683334 28619 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260503 07:57:44.725750 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 47432.7us
I20260503 07:57:44.783519 27999 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.725057 29090 consensus_queue.cc:1059] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260503 07:57:44.730396 28026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33294 (request call id 884) took 1565 ms (client timeout 1587 ms). Trace:
I20260503 07:57:44.730428 28073 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:44.731273 28029 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:44.677644 29170 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.667929 29183 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.677376 28964 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.733656 29199 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.781539 28033 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:44.733493 29159 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:44.738620 29100 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:44.740204 29179 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.774077 28103 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:57:44.795058 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 64717.5us
I20260503 07:57:44.800355 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 479) took 2080 ms. Trace:
W20260503 07:57:44.790355 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:44.787528 28100 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:57:44.802188 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:44.762071 29139 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.801239 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.776261 29111 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.741489 28970 consensus_queue.cc:1243] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer 25017111886b42cfa5701a39de59b6ad log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260503 07:57:44.843658 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 162265us
W20260503 07:57:44.845805 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 44647.5us
I20260503 07:57:44.844148 28033 rpcz_store.cc:276] 0503 07:57:42.720031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:42.850510 (+130479us) service_pool.cc:224] Handling call
0503 07:57:42.850796 (+ 286us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:43.970077 (+1119281us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b5400045720. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504699dfd 00007f8504680584 00007f8504702827 00007f850471b3c7 00007f850471cbbe 00007f8504726f29 00007f85047277f6 00007f850472416f 00007f8504723c1e 00007f85096f6ad9
0503 07:57:44.681310 (+711233us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400045720. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504699dfd 00007f8504680584 00007f8504702827 00007f850471b3c7 00007f850471cbbe 00007f8504726f29 00007f85047277f6 00007f850472416f 00007f8504723c1e 00007f85096f6ad9
0503 07:57:44.800144 (+118834us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.800306 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482283776}
I20260503 07:57:44.852047 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.858989 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.859115 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.859846 28108 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.860673 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.852463 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.789175 29064 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.841445 28101 raft_consensus.cc:2393] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:44.813485 29090 consensus_queue.cc:1243] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:44.873538 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:44.874308 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.813093 29159 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.876037 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.874045 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:44.881542 27999 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.862181 29199 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:44.874284 27926 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.877758 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:44.889140 27955 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.842149 29212 raft_consensus.cc:3055] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:44.842211 29053 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.848647 29140 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260503 07:57:44.843851 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 167328us
I20260503 07:57:44.889597 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.894956 27926 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:44.868705 29026 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.897815 27926 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:44.802610 29123 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:44.933274 29026 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.934816 29178 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:44.890177 29078 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:57:44.790024 28026 rpcz_store.cc:269] 0503 07:57:43.164667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:43.512923 (+348256us) service_pool.cc:224] Handling call
0503 07:57:44.730225 (+1217302us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400280fd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:44.730338 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084316416}
I20260503 07:57:44.883526 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:44.892766 29180 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.942652 27955 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:44.878293 29170 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260503 07:57:44.848410 29139 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:44.944362 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 71280.9us
I20260503 07:57:44.899089 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:44.896482 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:44.948499 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:44.946460 28073 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:44.939602 29178 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:44.897060 29121 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:44.929527 29007 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:44.941504 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:44.954523 28104 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.960318 29007 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:44.963583 29007 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:44.955019 29026 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:44.955830 29178 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.957116 29078 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:44.969436 29078 raft_consensus.cc:697] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:44.958338 28073 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:44.941175 29060 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:44.893801 29212 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:44.893487 29100 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:44.951087 29123 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:44.961284 28968 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:44.993266 28968 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:44.993677 28968 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:57:44.998442 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:44.961966 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.006211 28108 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:44.952270 29167 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260503 07:57:44.977250 27952 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:44.950790 28985 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260503 07:57:44.970176 29078 consensus_queue.cc:237] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.004952 28104 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
W20260503 07:57:45.022069 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 133367us
W20260503 07:57:45.006234 29234 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.059s user 0.000s sys 0.001s
W20260503 07:57:45.066226 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 107944us
I20260503 07:57:45.069361 27958 raft_consensus.cc:1240] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.022660 29100 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.106676 28109 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:45.124531 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 917) took 1256 ms. Trace:
I20260503 07:57:45.124961 28034 rpcz_store.cc:276] 0503 07:57:43.868352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.675508 (+807156us) service_pool.cc:224] Handling call
0503 07:57:44.675813 (+ 305us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.708082 (+ 32269us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.708122 (+ 40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.732390 (+ 24268us) log.cc:844] Serialized 26 byte log entry
0503 07:57:44.878514 (+146124us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:44.933519 (+ 55005us) log.cc:844] Serialized 14 byte log entry
0503 07:57:44.940211 (+ 6692us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.940281 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:44.968719 (+ 28438us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800394a20. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686b97 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:45.105130 (+136411us) raft_consensus.cc:1685] finished
0503 07:57:45.124320 (+ 19190us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.124469 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20421,"prepare.queue_time_us":55561,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":5217,"raft.queue_time_us":3459,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":4462,"spinlock_wait_cycles":8595840,"thread_start_us":102629,"threads_started":1,"wal-append.queue_time_us":173579}
I20260503 07:57:45.127492 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:45.128084 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.011269 28026 raft_consensus.cc:2376] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2. Re-sending same reply.
I20260503 07:57:45.095660 28966 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260503 07:57:45.107013 29141 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:45.152817 28108 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:45.129599 29121 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.166617 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.166326 29121 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.167248 28102 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:45.129307 29053 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.168522 29053 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:45.170140 29233 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.210s user 0.000s sys 0.000s
I20260503 07:57:45.170382 29053 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.171533 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 913) took 1483 ms. Trace:
I20260503 07:57:45.171480 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.172624 29007 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.158340 28978 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.173415 28978 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.174346 29007 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.175630 28978 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.172019 28027 rpcz_store.cc:276] 0503 07:57:43.687871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.657054 (+969183us) service_pool.cc:224] Handling call
0503 07:57:44.659668 (+ 2614us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.682593 (+ 22925us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.687891 (+ 5298us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.688366 (+ 475us) log.cc:844] Serialized 26 byte log entry
0503 07:57:44.864464 (+176098us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:44.937429 (+ 72965us) log.cc:844] Serialized 14 byte log entry
0503 07:57:44.946787 (+ 9358us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.950443 (+ 3656us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.171361 (+220918us) raft_consensus.cc:1685] finished
0503 07:57:45.171377 (+ 16us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.171486 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56546,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3511,"raft.queue_time_us":4089,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":8898,"thread_start_us":157134,"threads_started":1,"wal-append.queue_time_us":208167}
I20260503 07:57:45.179147 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.180176 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:45.181567 29236 log.cc:927] Time spent T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.172s user 0.000s sys 0.000s
I20260503 07:57:45.207806 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 55) took 1525 ms. Trace:
I20260503 07:57:45.208227 28031 rpcz_store.cc:276] 0503 07:57:43.682373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.646081 (+963708us) service_pool.cc:224] Handling call
0503 07:57:44.646308 (+ 227us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.646535 (+ 227us) raft_consensus.cc:1534] Early marking committed up to index 4
0503 07:57:44.646550 (+ 15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.646820 (+ 270us) log.cc:844] Serialized 26 byte log entry
0503 07:57:44.725731 (+ 78911us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b180026ad60. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501669587 00007f850a462bc9 00007f8501685cdb 00007f8501683f7f 00007f8501686242 00007f85042bd5ab 00007f85042c30c3 00007f85042c3471 00007f85046dfdef
0503 07:57:44.882000 (+156269us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:57:44.882039 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.882116 (+ 77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.182468 (+300352us) raft_consensus.cc:1685] finished
0503 07:57:45.182493 (+ 25us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.207750 (+ 25257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":4098,"spinlock_wait_cycles":2999552,"thread_start_us":156123,"threads_started":1,"wal-append.queue_time_us":305070}
I20260503 07:57:45.209740 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.210615 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.211122 28031 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:45.211485 28034 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:45.211860 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.212273 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.212492 28031 raft_consensus.cc:2368] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:45.212802 28034 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:45.214089 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.214980 28034 raft_consensus.cc:2393] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:45.216663 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.219800 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:45.221247 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 62871.5us
I20260503 07:57:45.024900 29212 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.168864 29121 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.163798 29141 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:45.182803 29180 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.162537 28992 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.234508 29208 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:45.223076 29227 log.cc:927] Time spent T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260503 07:57:45.227826 29238 consensus_queue.cc:1059] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260503 07:57:45.224759 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.232190 29141 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:45.182744 29240 consensus_queue.cc:1059] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260503 07:57:45.235828 29139 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:45.241799 29043 raft_consensus.cc:3055] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:45.230233 29096 consensus_queue.cc:1059] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260503 07:57:45.294130 29043 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.296427 29043 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.237423 29180 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.238795 28992 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.307488 29208 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:45.308799 29247 log.cc:927] Time spent T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260503 07:57:45.309085 28030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 909) took 1962 ms. Trace:
I20260503 07:57:45.309473 28030 rpcz_store.cc:276] 0503 07:57:43.346814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.539885 (+1193071us) service_pool.cc:224] Handling call
0503 07:57:44.540169 (+ 284us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.540471 (+ 302us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.540508 (+ 37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.541058 (+ 550us) log.cc:844] Serialized 26 byte log entry
0503 07:57:44.573642 (+ 32584us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:44.577778 (+ 4136us) log.cc:844] Serialized 14 byte log entry
0503 07:57:44.585299 (+ 7521us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:44.585368 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.307113 (+721745us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b180038ea80. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:45.308766 (+ 1653us) raft_consensus.cc:1685] finished
0503 07:57:45.308875 (+ 109us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.309030 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":2052,"raft.queue_time_us":19836,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":17919,"spinlock_wait_cycles":4172672,"thread_start_us":32205,"threads_started":1,"wal-append.queue_time_us":86391}
I20260503 07:57:45.318171 29180 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.318392 28027 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:45.319880 28992 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.320274 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 918) took 1073 ms. Trace:
I20260503 07:57:45.321125 28968 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.323123 28968 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:45.322916 29111 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.305326 29043 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.304467 29159 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.338603 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 903) took 2031 ms. Trace:
I20260503 07:57:45.338783 29159 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.339426 29199 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.341414 28031 raft_consensus.cc:2393] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:45.343427 28031 raft_consensus.cc:1275] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:45.343884 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 919) took 1096 ms. Trace:
I20260503 07:57:45.339073 28029 rpcz_store.cc:276] 0503 07:57:43.307436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:43.614675 (+307239us) service_pool.cc:224] Handling call
0503 07:57:44.730970 (+1116295us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:44.788362 (+ 57392us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.338374 (+550012us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400280fd0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504723c8d 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:45.338537 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566817024}
I20260503 07:57:45.344172 28031 rpcz_store.cc:276] 0503 07:57:44.247628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.342948 (+1095320us) service_pool.cc:224] Handling call
0503 07:57:45.343181 (+ 233us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.343702 (+ 521us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.343841 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:57:45.312716 27952 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:45.347602 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33288 (request call id 499) took 1234 ms. Trace:
I20260503 07:57:45.347970 29111 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:45.348143 28028 rpcz_store.cc:276] 0503 07:57:44.112779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.491340 (+378561us) service_pool.cc:224] Handling call
0503 07:57:45.347353 (+856013us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b54002387d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:45.347532 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127905536}
I20260503 07:57:45.350579 29005 raft_consensus.cc:3055] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:45.351011 29005 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.351837 29005 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:45.347647 28035 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.354032 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 916) took 1526 ms. Trace:
I20260503 07:57:45.354315 28035 rpcz_store.cc:276] 0503 07:57:43.827251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.665347 (+838096us) service_pool.cc:224] Handling call
0503 07:57:45.347495 (+682148us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.353384 (+ 5889us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.353887 (+ 503us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54002387d0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504723c8d 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:45.353989 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568328960}
I20260503 07:57:45.356254 29141 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.358623 28964 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.359553 29141 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:45.359236 28964 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.361348 29053 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.361816 29053 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:45.362594 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 136352us
I20260503 07:57:45.365531 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.367012 27926 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.369036 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 920) took 1121 ms. Trace:
I20260503 07:57:45.369547 28029 rpcz_store.cc:276] 0503 07:57:44.247872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.344933 (+1097061us) service_pool.cc:224] Handling call
0503 07:57:45.368215 (+ 23282us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.368521 (+ 306us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.368548 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:45.368585 (+ 37us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:45.368617 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.368680 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.368954 (+ 274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:57:45.371425 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 924) took 1122 ms. Trace:
I20260503 07:57:45.371809 28029 rpcz_store.cc:276] 0503 07:57:44.249026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.370591 (+1121565us) service_pool.cc:224] Handling call
0503 07:57:45.370905 (+ 314us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.371087 (+ 182us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.371119 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:45.371168 (+ 49us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:45.371206 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.371267 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.371371 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:57:45.373787 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 925) took 1124 ms. Trace:
I20260503 07:57:45.373799 27926 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.320700 28027 rpcz_store.cc:276] 0503 07:57:44.247295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.319322 (+1072027us) service_pool.cc:224] Handling call
0503 07:57:45.319659 (+ 337us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.319846 (+ 187us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.319899 (+ 53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:45.319959 (+ 60us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:45.320003 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.320082 (+ 79us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.320213 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:57:45.376492 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:45.376915 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:45.377524 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.378964 27926 leader_election.cc:400] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:45.379288 27926 leader_election.cc:403] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:45.379070 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:45.374593 28029 rpcz_store.cc:276] 0503 07:57:44.249299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.372855 (+1123556us) service_pool.cc:224] Handling call
0503 07:57:45.373256 (+ 401us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.373430 (+ 174us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.373482 (+ 52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:45.373533 (+ 51us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:45.373571 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.373632 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.373734 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:57:45.380043 28108 raft_consensus.cc:2393] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:45.380365 27926 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.380831 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 926) took 1131 ms. Trace:
I20260503 07:57:45.381456 28029 rpcz_store.cc:276] 0503 07:57:44.249554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.380211 (+1130657us) service_pool.cc:224] Handling call
0503 07:57:45.380426 (+ 215us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.380556 (+ 130us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.380575 (+ 19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:45.380608 (+ 33us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:45.380632 (+ 24us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.380675 (+ 43us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.380792 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:57:45.383984 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.384608 29078 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.384650 27956 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:45.390865 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:45.395520 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.405332 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.374480 29180 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.386049 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.369213 28985 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.410504 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.385717 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.381929 29183 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:45.412885 29159 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.413242 29183 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:45.409504 29078 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.414141 29183 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.410897 29250 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.416440 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.411757 28992 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.419107 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 494) took 1519 ms. Trace:
I20260503 07:57:45.399850 29005 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:45.391948 29199 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:45.420455 28075 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:45.384887 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.421139 28033 rpcz_store.cc:276] 0503 07:57:43.900182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.850971 (+950789us) service_pool.cc:224] Handling call
0503 07:57:44.851353 (+ 382us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.853274 (+ 1921us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.853316 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.868594 (+ 15278us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.075647 (+207053us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:45.140197 (+ 64550us) log.cc:844] Serialized 14 byte log entry
0503 07:57:45.312662 (+172465us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b1800383e60. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501654be6 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01
0503 07:57:45.313156 (+ 494us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b1800383e60. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:45.356656 (+ 43500us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800383e60. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f85015fae1a 00007f850ac9c5c9 00007f85014b91f0 00007f8501683b24 00007f8501683a95 00007f850471c440 00007f850472eaf6 00007f850473f667 00007f850473f5e8
0503 07:57:45.358343 (+ 1687us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b48002526d8. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850965c1a1 00007f8509653237 00007f85096530ca 00007f850974a92f 00007f850974a5f7 00007f850975ec1c 00007f850975ebc8 00007f850975eb48 00007f850975eb03 00007f850975ddac 00007f8508686b36
0503 07:57:45.418818 (+ 60475us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.418891 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.418936 (+ 45us) raft_consensus.cc:1685] finished
0503 07:57:45.418950 (+ 14us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.419055 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71401,"prepare.queue_time_us":75072,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":231247,"raft.run_cpu_time_us":7878,"raft.run_wall_time_us":494009,"spinlock_wait_cycles":88406144,"thread_start_us":207703,"threads_started":2,"wal-append.queue_time_us":271944}
I20260503 07:57:45.388218 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.424630 28964 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.386370 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.415200 29078 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.453675 27924 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:45.431051 29123 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.434165 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.434744 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.437412 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:45.468293 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.468601 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.436934 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.439127 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.468904 28107 raft_consensus.cc:2368] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:45.469599 27959 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:45.469856 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.470362 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.448851 29180 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260503 07:57:45.470882 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.471393 28107 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:45.472100 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.385397 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.477761 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.478669 29078 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:45.479832 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:45.480546 29078 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:45.480909 29078 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.481280 29078 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.443832 28108 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:45.404264 29154 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.388355 29208 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:45.444375 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.485388 28105 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:45.409760 28978 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:45.439523 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.487385 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:45.448042 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.454856 29007 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:45.457237 28952 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:45.489303 28033 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:45.456460 29139 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:45.459087 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:45.459133 28622 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:45.460487 27952 raft_consensus.cc:2393] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:45.460646 29053 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.460880 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.492336 27955 raft_consensus.cc:2393] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:45.460976 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.462864 27956 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:45.465583 28103 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:45.420243 29250 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:45.415716 28026 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
W20260503 07:57:45.457847 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.493414 28107 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260503 07:57:45.495554 28107 pending_rounds.cc:85] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: Aborting all ops after (but not including) 4
I20260503 07:57:45.489481 27951 raft_consensus.cc:2393] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:45.495816 28107 pending_rounds.cc:107] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260503 07:57:45.496446 28107 raft_consensus.cc:2889] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:45.497582 28978 raft_consensus.cc:697] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:45.497925 29070 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:45.498468 28978 consensus_queue.cc:237] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.499403 28992 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:45.499759 28992 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.500021 29140 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:45.500455 29140 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:45.500716 28033 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:45.500093 28992 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.501817 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.449303 29199 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:45.502172 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.491155 29007 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:57:45.504405 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.504528 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.505187 28033 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:45.506029 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.506572 28033 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:45.504882 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.495625 29005 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
W20260503 07:57:45.508662 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.508729 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.507099 29007 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.511627 29199 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.489629 29123 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260503 07:57:45.515434 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:57:45.517838 29235 log.cc:927] Time spent T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.638s user 0.009s sys 0.000s
I20260503 07:57:45.528564 29123 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.507370 29071 consensus_queue.cc:1059] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260503 07:57:45.522975 28033 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:45.523007 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 491) took 1623 ms. Trace:
I20260503 07:57:45.529073 29123 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.529999 29071 raft_consensus.cc:3055] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:45.531562 29071 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.507866 29255 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:45.530985 29250 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:45.533330 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 923) took 1284 ms. Trace:
I20260503 07:57:45.533787 28035 rpcz_store.cc:276] 0503 07:57:44.248738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.355020 (+1106282us) service_pool.cc:224] Handling call
0503 07:57:45.532763 (+177743us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800002498. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:57:45.532921 (+ 158us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.533078 (+ 157us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.533102 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:45.533134 (+ 32us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:45.533161 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.533207 (+ 46us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.533290 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31238400}
I20260503 07:57:45.526034 27924 leader_election.cc:400] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:45.515583 29078 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.525377 29053 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.525373 28992 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.527249 28964 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.524489 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.530568 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.534868 27924 leader_election.cc:403] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:45.538704 28033 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:45.533595 29250 raft_consensus.cc:697] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:45.537257 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.503021 29124 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260503 07:57:45.559180 27955 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:45.529323 28032 rpcz_store.cc:276] 0503 07:57:43.899415 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.735470 (+836055us) service_pool.cc:224] Handling call
0503 07:57:44.735831 (+ 361us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:44.812008 (+ 76177us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:44.812032 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:44.959193 (+147161us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b2c00006d78. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850301ec81 00007f850302e5e2 00007f850475fde1 00007f850472481a 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22
0503 07:57:44.973664 (+ 14471us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.161843 (+188179us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:45.215976 (+ 54133us) log.cc:844] Serialized 14 byte log entry
0503 07:57:45.363709 (+147733us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.522748 (+159039us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b54001ef854. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:57:45.522791 (+ 43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.522831 (+ 40us) raft_consensus.cc:1685] finished
0503 07:57:45.522846 (+ 15us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.522960 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170357,"prepare.queue_time_us":54164,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":3158,"raft.queue_time_us":154245,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":28920,"spinlock_wait_cycles":165815424,"thread_start_us":153475,"threads_started":1,"wal-append.queue_time_us":223682}
I20260503 07:57:45.539001 28075 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:45.539749 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.540004 27926 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.542162 29208 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:45.546648 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.536810 28964 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.547742 29053 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.548801 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53082 (request call id 59) took 5482 ms. Trace:
I20260503 07:57:45.550789 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.548556 29250 consensus_queue.cc:237] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.534595 29005 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.570096 27954 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:45.569519 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.561584 28026 raft_consensus.cc:1240] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.574570 28027 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.575811 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:45.571973 29183 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:45.575456 27955 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:45.578796 28035 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:45.579226 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:45.533193 29071 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.580940 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:45.584022 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.586753 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.588104 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.596685 28075 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:45.598047 28992 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.598091 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.601646 28035 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.602211 28964 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.585422 29199 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.603350 29179 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:45.607388 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:45.608481 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:45.609414 29100 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:45.580345 29183 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.613471 29183 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.572348 27857 rpcz_store.cc:276] 0503 07:57:40.066375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:40.073170 (+ 6795us) service_pool.cc:224] Handling call
0503 07:57:45.548725 (+5475555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:57:44.192233 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:57:44.323904 (+131671us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:57:44.323933 (+ 29us) write_op.cc:435] Acquired schema lock
0503 07:57:44.323953 (+ 20us) tablet.cc:662] Decoding operations
0503 07:57:44.324269 (+ 316us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:57:44.324338 (+ 69us) write_op.cc:641] Partition lock acquired for write op
0503 07:57:44.324388 (+ 50us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:57:44.324583 (+ 195us) tablet.cc:701] Row locks acquired
0503 07:57:44.324604 (+ 21us) write_op.cc:260] PREPARE: finished
0503 07:57:44.324762 (+ 158us) write_op.cc:270] Start()
0503 07:57:44.324895 (+ 133us) write_op.cc:276] Timestamp: P: 1777795064324718 usec, L: 0
0503 07:57:44.324920 (+ 25us) op_driver.cc:348] REPLICATION: starting
0503 07:57:44.325564 (+ 644us) log.cc:844] Serialized 529 byte log entry
0503 07:57:44.592322 (+266758us) op_driver.cc:464] REPLICATION: finished
0503 07:57:44.667631 (+ 75309us) write_op.cc:301] APPLY: starting
0503 07:57:44.667717 (+ 86us) tablet.cc:1367] starting BulkCheckPresence
0503 07:57:44.667814 (+ 97us) tablet.cc:1370] finished BulkCheckPresence
0503 07:57:44.674813 (+ 6999us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:57:44.676197 (+ 1384us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:57:44.676339 (+ 142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:57:44.676387 (+ 48us) write_op.cc:312] APPLY: finished
0503 07:57:44.676560 (+ 173us) log.cc:844] Serialized 22 byte log entry
0503 07:57:44.676707 (+ 147us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:44.676779 (+ 72us) write_op.cc:454] Released schema lock
0503 07:57:44.676813 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0503 07:57:44.732457 (+ 55644us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:44.733474 (+ 1017us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1581646,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":64225,"apply.run_cpu_time_us":1903,"apply.run_wall_time_us":18779,"num_ops":1,"prepare.queue_time_us":135508,"prepare.run_cpu_time_us":21269,"prepare.run_wall_time_us":202443,"raft.queue_time_us":119578,"raft.run_cpu_time_us":2561,"raft.run_wall_time_us":48022,"replication_time_us":267269,"thread_start_us":229056,"threads_started":4,"wal-append.queue_time_us":86905}]]}
I20260503 07:57:45.585608 29255 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:45.620976 28107 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:45.622769 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.625823 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.588801 29060 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:45.593209 29208 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:45.587939 29096 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:45.592756 29159 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:57:45.605871 29070 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:45.595402 29026 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:45.603925 29199 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.580139 29007 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.603953 29064 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:45.646765 27924 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:45.632849 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:45.579013 29005 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.654879 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.593132 29196 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260503 07:57:45.634511 29060 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.656101 29026 raft_consensus.cc:697] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:45.657399 29167 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:45.646366 29208 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.665408 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:45.658591 28026 raft_consensus.cc:1240] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.659484 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.659761 28104 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:45.650952 29071 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.655817 29096 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.661600 29078 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.632071 29154 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.663939 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.669629 27958 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.664435 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.651930 29238 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:45.649590 29070 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.670506 27955 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:45.650955 29123 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.670506 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.669436 29026 consensus_queue.cc:237] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:45.670104 29167 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:45.672413 28106 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:45.662104 29255 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:45.676105 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:45.651342 29037 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260503 07:57:45.678558 29007 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.667645 29208 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.664127 29159 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:45.682608 27951 raft_consensus.cc:2393] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:45.681636 29123 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:45.683420 29078 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:45.683854 29078 raft_consensus.cc:697] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:45.684643 29078 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.665428 29060 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.667528 29064 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.694310 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:45.675119 29070 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.701486 29070 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:45.687155 29255 raft_consensus.cc:697] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:45.674830 29167 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.679811 29154 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260503 07:57:45.679234 29096 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:45.713930 29256 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.259s user 0.000s sys 0.002s
I20260503 07:57:45.715444 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.716130 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.691650 29210 consensus_queue.cc:1059] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260503 07:57:45.723155 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.724896 29196 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:45.725710 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 495) took 1825 ms. Trace:
I20260503 07:57:45.726082 28034 rpcz_store.cc:276] 0503 07:57:43.900438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.225152 (+1324714us) service_pool.cc:224] Handling call
0503 07:57:45.225490 (+ 338us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:45.376175 (+150685us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.376217 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:45.376645 (+ 428us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.451820 (+ 75175us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:45.451862 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.451918 (+ 56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.713573 (+261655us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f85042bec0e 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1 00007f85042c7579 00007f85042c7509
0503 07:57:45.725387 (+ 11814us) raft_consensus.cc:1685] finished
0503 07:57:45.725417 (+ 30us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.725659 (+ 242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156348,"raft.queue_time_us":154020,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2953,"spinlock_wait_cycles":27916160,"thread_start_us":74937,"threads_started":1,"wal-append.queue_time_us":77854}
I20260503 07:57:45.727860 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.728049 29123 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:45.728469 29123 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.729725 28026 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260503 07:57:45.730208 29123 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.730693 29123 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:45.732321 28034 raft_consensus.cc:2393] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:45.731062 29123 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:45.734519 29265 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.065s user 0.000s sys 0.003s
I20260503 07:57:45.736181 28026 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:45.736550 29123 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.735086 29064 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.714852 29199 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.741982 29238 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:45.742362 29238 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:45.700958 29060 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:45.750341 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.752246 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.753643 29180 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:45.756994 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.759783 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.759972 28035 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.744587 29053 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:45.756600 29141 raft_consensus.cc:1064] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:45.751673 29251 raft_consensus.cc:3055] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:45.769665 27999 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.772684 28964 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:45.771808 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.774920 27951 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:45.772580 29255 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.770134 29251 raft_consensus.cc:740] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:57:45.782018 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.780005 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:45.781212 29251 consensus_queue.cc:260] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.784385 29251 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.798280 28031 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:45.799005 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 921) took 1550 ms. Trace:
I20260503 07:57:45.799403 28031 rpcz_store.cc:276] 0503 07:57:44.248141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.355600 (+1107459us) service_pool.cc:224] Handling call
0503 07:57:45.797805 (+442205us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800002498. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:57:45.797984 (+ 179us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.798738 (+ 754us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.798961 (+ 223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30654208}
I20260503 07:57:45.801263 28031 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:45.801841 27954 raft_consensus.cc:1275] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:45.787608 28964 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:45.776234 29140 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.809634 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:45.809942 29140 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:45.810460 29140 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:45.811542 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.812273 27954 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:45.813195 29196 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:45.794503 28104 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:45.804503 29183 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.819162 29183 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.831540 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:45.831772 29261 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.111s user 0.000s sys 0.001s
I20260503 07:57:45.821646 28109 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:45.832635 27952 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:45.831549 27924 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:45.838989 29212 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:45.839213 29180 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:45.802518 29078 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.839690 29180 raft_consensus.cc:697] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:45.807399 29060 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.821712 28964 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:45.844985 28964 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:45.855485 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:45.868257 29026 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:45.844959 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.870496 27954 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:45.840734 29238 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.911506 27957 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260503 07:57:45.865877 29159 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:45.843725 29078 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.922978 28073 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:45.926854 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 505) took 1363 ms. Trace:
I20260503 07:57:45.852725 28985 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260503 07:57:45.927290 28029 rpcz_store.cc:276] 0503 07:57:44.563103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.382353 (+819250us) service_pool.cc:224] Handling call
0503 07:57:45.382597 (+ 244us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:45.445581 (+ 62984us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.445620 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:45.804436 (+358816us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b2c00006d78. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850301ec81 00007f850302e5e2 00007f850475fde1 00007f850472481a 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22
0503 07:57:45.804754 (+ 318us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.871621 (+ 66867us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:45.912931 (+ 41310us) log.cc:844] Serialized 14 byte log entry
0503 07:57:45.914789 (+ 1858us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.914854 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.914897 (+ 43us) raft_consensus.cc:1685] finished
0503 07:57:45.926646 (+ 11749us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:45.926792 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65569,"prepare.queue_time_us":41193,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":4718,"raft.queue_time_us":63354,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":7212,"spinlock_wait_cycles":9315200,"thread_start_us":65833,"threads_started":1,"wal-append.queue_time_us":64696}
W20260503 07:57:45.935669 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:45.948185 27957 raft_consensus.cc:1275] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:45.949643 29060 consensus_queue.cc:1059] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260503 07:57:45.952936 29060 raft_consensus.cc:3055] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:45.953307 29060 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:45.954080 29060 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.955705 29060 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:45.956540 29078 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:45.926222 29159 raft_consensus.cc:697] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:45.929949 27951 raft_consensus.cc:2393] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:45.958812 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:45.948665 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:45.958303 28109 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:45.930722 29071 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:45.974490 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:45.968540 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:45.980147 29071 raft_consensus.cc:697] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:45.983031 28107 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:45.963243 29255 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260503 07:57:45.929790 29180 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:45.990245 29238 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:45.990743 29208 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:45.984362 29277 log.cc:927] Time spent T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
W20260503 07:57:45.995890 29269 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260503 07:57:46.001793 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:46.002781 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:46.003173 28034 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:46.007737 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:46.008819 27926 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:46.010624 29121 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:46.008494 28992 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:46.016726 28034 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:46.015172 29208 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.179314 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 922) took 1930 ms. Trace:
I20260503 07:57:46.180116 28101 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:46.193148 29208 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:46.193531 29199 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:46.193773 29208 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.194324 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 929) took 1323 ms. Trace:
I20260503 07:57:46.182180 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:46.181409 28622 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:46.183753 29121 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:45.981396 29071 consensus_queue.cc:237] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.186306 28992 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:46.191802 29053 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:46.189523 29250 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:46.180248 28964 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.194080 29199 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:45.993316 29159 consensus_queue.cc:237] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.194681 28032 rpcz_store.cc:276] 0503 07:57:44.870579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.563665 (+693086us) service_pool.cc:224] Handling call
0503 07:57:45.563885 (+ 220us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.582421 (+ 18536us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.582462 (+ 41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:45.582512 (+ 50us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:45.582554 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:46.194138 (+611584us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b540026cd54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:57:46.194178 (+ 40us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:46.194280 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42214144}
W20260503 07:57:46.196013 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 178237us
I20260503 07:57:46.202291 28106 raft_consensus.cc:1275] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:46.215936 28032 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:46.204802 28034 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260503 07:57:46.193833 29259 log.cc:927] Time spent T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.533s user 0.003s sys 0.003s
W20260503 07:57:46.205400 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.197642 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:46.186897 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:46.229494 29209 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260503 07:57:46.217732 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.218097 29250 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.230336 29026 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:46.208997 29053 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:46.231267 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.231982 29250 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.221520 28964 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.222854 29199 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:46.232518 29053 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.234432 29213 consensus_queue.cc:1059] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:46.235337 29213 raft_consensus.cc:3055] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:46.235675 29213 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:46.225173 27856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 194) took 5052 ms. Trace:
I20260503 07:57:46.199344 29179 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:46.237721 29179 raft_consensus.cc:697] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:46.237494 27856 rpcz_store.cc:276] 0503 07:57:41.163444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:41.169400 (+ 5956us) service_pool.cc:224] Handling call
0503 07:57:46.215885 (+5046485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":861503,"reported_tablets":4}
I20260503 07:57:46.238773 29179 consensus_queue.cc:237] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.239257 28109 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:46.210320 29196 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:46.229207 29255 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:46.241482 29196 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:46.243255 29196 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:46.207480 28992 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.247561 28992 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.248301 29208 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.252689 29164 consensus_queue.cc:1059] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:46.253376 29164 consensus_queue.cc:1243] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer be26cebb7c90445ea9a74f66463457c1 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:46.253819 29164 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:46.254132 29164 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:46.254873 29164 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.256016 29164 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:46.257170 29238 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:46.257611 27951 raft_consensus.cc:1275] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:46.257637 29238 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.204044 29121 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.263782 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:46.260941 29091 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:46.189740 28028 rpcz_store.cc:276] 0503 07:57:44.248437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.349693 (+1101256us) service_pool.cc:224] Handling call
0503 07:57:45.734916 (+385223us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800002498. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:57:45.735096 (+ 180us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:45.744504 (+ 9408us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.749390 (+ 4886us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:45.762718 (+ 13328us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.913563 (+150845us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:45.985193 (+ 71630us) log.cc:844] Serialized 14 byte log entry
0503 07:57:45.991279 (+ 6086us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.991357 (+ 78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.991405 (+ 48us) raft_consensus.cc:1685] finished
0503 07:57:46.013269 (+ 21864us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:46.179257 (+165988us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145,"prepare.queue_time_us":46943,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2366,"raft.queue_time_us":634,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":5923,"spinlock_wait_cycles":54999296,"thread_start_us":114236,"threads_started":2,"wal-append.queue_time_us":143843}
I20260503 07:57:46.265456 29091 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:46.266644 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 517) took 1108 ms. Trace:
W20260503 07:57:46.272980 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 53926.9us
I20260503 07:57:46.276157 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.274076 28031 rpcz_store.cc:276] 0503 07:57:45.158178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.816852 (+658674us) service_pool.cc:224] Handling call
0503 07:57:45.817197 (+ 345us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:45.817471 (+ 274us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.817498 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:45.818381 (+ 883us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.920205 (+101824us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:46.266117 (+345912us) log.cc:844] Serialized 14 byte log entry
0503 07:57:46.266346 (+ 229us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:46.266404 (+ 58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:46.266456 (+ 52us) raft_consensus.cc:1685] finished
0503 07:57:46.266471 (+ 15us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:46.266599 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9542,"prepare.queue_time_us":58008,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":9596,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"thread_start_us":409864,"threads_started":2,"wal-append.queue_time_us":112843}
I20260503 07:57:46.279691 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.282622 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.284405 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:46.287770 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:46.293774 27954 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:46.295246 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:46.295907 28109 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:46.236835 29213 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.291154 29196 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:46.310817 28109 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:46.294898 28992 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:46.314445 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.315145 29091 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:46.298640 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:46.313719 29196 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:46.317915 29196 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:46.321434 28102 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:46.321832 28029 raft_consensus.cc:2410] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260503 07:57:46.303862 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:46.323251 28992 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.323632 28978 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:46.324090 28978 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.316469 29121 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.306002 28026 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:46.336752 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:46.340674 29238 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:46.311935 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.343603 28992 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.335589 29213 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:46.347667 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 57342.7us
I20260503 07:57:46.349958 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 927) took 1480 ms. Trace:
I20260503 07:57:46.351415 28978 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.351336 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:46.355633 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.357625 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:46.367908 27924 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:46.370482 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.373886 29007 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:46.374517 29007 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:46.380093 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:46.385869 27955 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:46.386154 28104 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:46.387002 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 936) took 1513 ms. Trace:
I20260503 07:57:46.387434 28035 rpcz_store.cc:276] 0503 07:57:44.873331 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.602362 (+729031us) service_pool.cc:224] Handling call
0503 07:57:45.602637 (+ 275us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.760407 (+157770us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:46.386733 (+626326us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002396d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:57:46.386938 (+ 205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361492864}
I20260503 07:57:46.380910 29007 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.382037 27958 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260503 07:57:46.399219 27958 pending_rounds.cc:85] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Aborting all ops after (but not including) 1
I20260503 07:57:46.399469 27958 pending_rounds.cc:107] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260503 07:57:46.399712 27958 raft_consensus.cc:2889] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:46.368674 28027 rpcz_store.cc:276] 0503 07:57:44.869910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.406008 (+536098us) service_pool.cc:224] Handling call
0503 07:57:45.571985 (+165977us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:45.576205 (+ 4220us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:46.349747 (+773542us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540024b8d0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504723c8d 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:46.349905 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339310976}
I20260503 07:57:46.372320 29208 consensus_queue.cc:1059] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260503 07:57:46.431921 28100 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:46.398976 29167 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:46.463876 28100 raft_consensus.cc:1275] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:46.482908 29154 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:46.496121 28030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 497) took 2384 ms. Trace:
I20260503 07:57:46.444607 29183 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260503 07:57:46.496596 28030 rpcz_store.cc:276] 0503 07:57:44.112204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.311328 (+1199124us) service_pool.cc:224] Handling call
0503 07:57:45.311646 (+ 318us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:45.379852 (+ 68206us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.381330 (+ 1478us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:45.703286 (+321956us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b2c00006d78. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850301ec81 00007f850302e5e2 00007f850475fde1 00007f850472481a 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22
0503 07:57:45.703787 (+ 501us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.756650 (+ 52863us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:45.779827 (+ 23177us) log.cc:844] Serialized 14 byte log entry
0503 07:57:45.802643 (+ 22816us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.820945 (+ 18302us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:46.493400 (+672455us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b180033dae0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:46.495903 (+ 2503us) raft_consensus.cc:1685] finished
0503 07:57:46.495933 (+ 30us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:46.496061 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62851,"prepare.queue_time_us":15697,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":71623,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":17928,"spinlock_wait_cycles":24864896,"thread_start_us":45791,"threads_started":1,"wal-append.queue_time_us":73880}
I20260503 07:57:46.499426 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:46.499468 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.519570 28108 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:46.521368 27957 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260503 07:57:46.529975 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 110374us
I20260503 07:57:46.534662 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:57:46.539899 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.543391 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:46.561882 27999 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:46.575232 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:46.549772 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.531291 29196 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:46.581772 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:46.472453 29167 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.547158 29255 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260503 07:57:46.600517 29263 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.948s user 0.003s sys 0.001s
W20260503 07:57:46.601195 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 56566.7us
I20260503 07:57:46.587220 28964 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:57:46.675242 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 143306us
I20260503 07:57:46.598814 29255 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:46.645870 29121 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:57:46.720103 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 118645us
W20260503 07:57:46.730847 29293 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.128s user 0.000s sys 0.000s
W20260503 07:57:46.731547 29264 log.cc:927] Time spent T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 1.055s user 0.001s sys 0.003s
I20260503 07:57:46.700089 29255 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
W20260503 07:57:46.789527 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:46.915113 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 192920us
I20260503 07:57:46.916395 29121 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.917466 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:46.918272 29121 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:46.918563 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 242652us
I20260503 07:57:46.918758 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:46.919636 29208 consensus_queue.cc:1048] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:46.919924 29167 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:46.925740 29213 consensus_meta.cc:287] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.562s user 0.010s sys 0.004s
W20260503 07:57:46.927219 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.928536 28105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 543) took 1366 ms. Trace:
I20260503 07:57:46.929509 28101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 532) took 1777 ms. Trace:
W20260503 07:57:46.929677 29262 log.cc:927] Time spent T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 1.277s user 0.003s sys 0.000s
I20260503 07:57:46.929961 28101 rpcz_store.cc:276] 0503 07:57:45.152434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.154974 (+ 2540us) service_pool.cc:224] Handling call
0503 07:57:45.169686 (+ 14712us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:46.192732 (+1023046us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:46.929261 (+736529us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540037c8d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:57:46.929453 (+ 192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323056896}
I20260503 07:57:46.931624 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 930) took 2060 ms. Trace:
I20260503 07:57:46.931820 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 955) took 1353 ms. Trace:
I20260503 07:57:46.928844 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33294 (request call id 961) took 1079 ms. Trace:
I20260503 07:57:46.933262 28029 rpcz_store.cc:276] 0503 07:57:45.849627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.948428 (+ 98801us) service_pool.cc:224] Handling call
0503 07:57:46.928657 (+980229us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540024c7d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:46.928789 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829610240}
I20260503 07:57:46.931985 28033 rpcz_store.cc:276] 0503 07:57:44.870868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.570460 (+699592us) service_pool.cc:224] Handling call
0503 07:57:45.570716 (+ 256us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:45.573803 (+ 3087us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.573832 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:45.575390 (+ 1558us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.633701 (+ 58311us) raft_consensus.cc:1645] Marking committed up to 3
0503 07:57:45.633968 (+ 267us) log.cc:844] Serialized 14 byte log entry
0503 07:57:45.634130 (+ 162us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.634260 (+ 130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:45.738198 (+103938us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18002edda0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:57:46.929149 (+1190951us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f85042bec0e 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1 00007f85042c7579 00007f85042c7509
0503 07:57:46.931433 (+ 2284us) raft_consensus.cc:1685] finished
0503 07:57:46.931453 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:46.931565 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":84,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1005,"raft.queue_time_us":9404,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3707,"spinlock_wait_cycles":72983680,"thread_start_us":58074,"threads_started":1,"wal-append.queue_time_us":77162}
I20260503 07:57:46.932293 28031 rpcz_store.cc:276] 0503 07:57:45.578304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.281114 (+702810us) service_pool.cc:224] Handling call
0503 07:57:46.281364 (+ 250us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:46.289231 (+ 7867us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:46.289268 (+ 37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:46.292903 (+ 3635us) log.cc:844] Serialized 26 byte log entry
0503 07:57:46.499849 (+206946us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:46.540263 (+ 40414us) log.cc:844] Serialized 14 byte log entry
0503 07:57:46.547375 (+ 7112us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:46.547459 (+ 84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:46.931634 (+384175us) raft_consensus.cc:1685] finished
0503 07:57:46.931653 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:46.931762 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15838,"prepare.queue_time_us":39998,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":18307,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":33771,"spinlock_wait_cycles":12425088,"thread_start_us":177746,"threads_started":1,"wal-append.queue_time_us":623928}
I20260503 07:57:46.928885 28105 rpcz_store.cc:276] 0503 07:57:45.562371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.562522 (+ 151us) service_pool.cc:224] Handling call
0503 07:57:45.562776 (+ 254us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:45.572211 (+ 9435us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.572239 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:45.580802 (+ 8563us) log.cc:844] Serialized 26 byte log entry
0503 07:57:45.646853 (+ 66051us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:45.646877 (+ 24us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:45.646948 (+ 71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:46.580324 (+933376us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f85042bec0e 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1 00007f85042c7579 00007f85042c7509
0503 07:57:46.928243 (+347919us) raft_consensus.cc:1685] finished
0503 07:57:46.928266 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:46.928449 (+ 183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12592,"raft.queue_time_us":15401,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":5286,"spinlock_wait_cycles":16168192,"thread_start_us":37794,"threads_started":1,"wal-append.queue_time_us":77657}
I20260503 07:57:46.936586 28033 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260503 07:57:46.939443 29007 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:46.939934 29007 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.941757 28033 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
W20260503 07:57:46.942822 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 361100us
I20260503 07:57:46.943411 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:46.944924 28033 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:46.945750 29053 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:46.536278 29060 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260503 07:57:46.955225 29007 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:46.983968 28033 raft_consensus.cc:1275] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:46.920730 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:46.986027 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 70296.6us
I20260503 07:57:46.946329 29053 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
W20260503 07:57:47.002974 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 76769.7us
W20260503 07:57:47.003348 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:46.778342 29196 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:46.946693 29173 consensus_queue.cc:1059] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260503 07:57:47.006505 29053 raft_consensus.cc:697] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:47.010156 29091 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260503 07:57:47.012295 29173 consensus_queue.cc:1243] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer be26cebb7c90445ea9a74f66463457c1 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:47.041841 29196 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:47.053653 29301 log.cc:927] Time spent T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.068s user 0.000s sys 0.005s
I20260503 07:57:47.055364 29255 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.057889 29255 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.091674 27956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45176 (request call id 759) took 1381 ms. Trace:
I20260503 07:57:47.092659 27956 rpcz_store.cc:276] 0503 07:57:45.710103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.710226 (+ 123us) service_pool.cc:224] Handling call
0503 07:57:45.710552 (+ 326us) raft_consensus.cc:1471] Updating replica for 2 ops
0503 07:57:45.712441 (+ 1889us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:45.712479 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0503 07:57:46.322531 (+610052us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b2c00000a78. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850301ec81 00007f850302e5e2 00007f850475fde1 00007f850472481a 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22
0503 07:57:46.322987 (+ 456us) log.cc:844] Serialized 52 byte log entry
0503 07:57:46.505253 (+182266us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:46.777020 (+271767us) log.cc:844] Serialized 14 byte log entry
0503 07:57:47.090378 (+313358us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.090600 (+ 222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:47.090783 (+ 183us) raft_consensus.cc:1685] finished
0503 07:57:47.090984 (+ 201us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:47.091361 (+ 377us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":93247,"prepare.run_cpu_time_us":6632,"prepare.run_wall_time_us":298919,"raft.queue_time_us":140261,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":1274,"spinlock_wait_cycles":6018944,"thread_start_us":610953,"threads_started":3,"wal-append.queue_time_us":213736}
W20260503 07:57:47.098327 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 154823us
I20260503 07:57:47.101643 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.104681 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.108609 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:33286 (request call id 358) took 3170 ms. Trace:
I20260503 07:57:47.109213 28029 rpcz_store.cc:276] 0503 07:57:43.829386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.998157 (+3168771us) service_pool.cc:224] Handling call
0503 07:57:47.000235 (+ 2078us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:57:47.108912 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 100272us
I20260503 07:57:47.110518 29315 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.111786 29315 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:47.114403 29315 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:47.117486 27956 raft_consensus.cc:3055] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:47.117894 27956 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:47.109371 28027 raft_consensus.cc:2410] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260503 07:57:47.119387 27956 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.121541 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 527) took 1249 ms. Trace:
I20260503 07:57:47.122530 27956 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:57:47.125917 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:47.121942 28035 rpcz_store.cc:276] 0503 07:57:45.871730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.407058 (+535328us) service_pool.cc:224] Handling call
0503 07:57:46.452702 (+ 45644us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:46.505451 (+ 52749us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:46.505490 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:46.505944 (+ 454us) log.cc:844] Serialized 26 byte log entry
0503 07:57:46.604598 (+ 98654us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:46.604629 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:46.604697 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:47.121085 (+516388us) raft_consensus.cc:1685] finished
0503 07:57:47.121117 (+ 32us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:47.121348 (+ 231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52274,"raft.queue_time_us":78598,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4324,"thread_start_us":53237,"threads_started":1,"wal-append.queue_time_us":473592}
W20260503 07:57:47.127310 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 121164us
I20260503 07:57:47.129208 27955 raft_consensus.cc:1275] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260503 07:57:47.143348 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.144493 28027 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:47.144184 29005 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:47.148240 29007 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.150250 29053 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.150907 29159 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.151676 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.151669 29159 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.153363 29121 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.154309 29121 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.155740 28029 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:47.158373 29298 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:47.162042 29290 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.162228 29082 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.162467 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.162782 29290 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.163014 29082 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.165434 28035 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:47.165648 29290 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:47.169065 28027 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:47.172755 29007 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.175293 29007 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.178004 29311 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.177724 29141 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:47.178966 29311 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.156788 29121 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.182554 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.182708 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.186667 29082 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:47.187108 28035 raft_consensus.cc:1275] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260503 07:57:47.187300 28108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43222 (request call id 800) took 1222 ms. Trace:
I20260503 07:57:47.190224 27955 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:47.187794 28108 rpcz_store.cc:276] 0503 07:57:45.964409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:45.964546 (+ 137us) service_pool.cc:224] Handling call
0503 07:57:45.964783 (+ 237us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:46.519920 (+555137us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.186839 (+666919us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54000a7154. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:57:47.187108 (+ 269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275507456}
I20260503 07:57:47.187513 28035 pending_rounds.cc:85] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 1
I20260503 07:57:47.192305 28035 pending_rounds.cc:107] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260503 07:57:47.193472 28035 raft_consensus.cc:2889] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:47.195324 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 966) took 1203 ms. Trace:
I20260503 07:57:47.195727 28034 rpcz_store.cc:276] 0503 07:57:45.989509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.537362 (+547853us) service_pool.cc:224] Handling call
0503 07:57:47.180213 (+642851us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b5800002498. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:57:47.180514 (+ 301us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:47.180845 (+ 331us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:47.180882 (+ 37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:47.180942 (+ 60us) raft_consensus.cc:1645] Marking committed up to 1
0503 07:57:47.180971 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.191980 (+ 11009us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:47.193041 (+ 1061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16388352}
W20260503 07:57:47.201841 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:47.214602 27952 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:47.215340 27952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45176 (request call id 772) took 1017 ms. Trace:
I20260503 07:57:47.215700 27952 rpcz_store.cc:276] 0503 07:57:46.198694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.200641 (+ 1947us) service_pool.cc:224] Handling call
0503 07:57:47.213772 (+1013131us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800000998. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:57:47.214066 (+ 294us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:47.215036 (+ 970us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.215273 (+ 237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24281472}
I20260503 07:57:47.216472 27926 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.217883 29007 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:47.218613 29007 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.221957 27957 raft_consensus.cc:3055] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:47.220798 29007 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.222411 27957 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:47.223390 29007 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:47.223659 29213 raft_consensus.cc:3055] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:47.227061 29213 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:47.228381 29213 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.230180 29213 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:47.223264 27957 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.236857 27956 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260503 07:57:47.237294 27956 pending_rounds.cc:85] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Aborting all ops after (but not including) 1
I20260503 07:57:47.238350 27956 pending_rounds.cc:107] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260503 07:57:47.238598 27956 raft_consensus.cc:2889] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:47.239939 27957 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.245337 29043 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.246183 29043 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:47.251139 29026 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260503 07:57:47.252120 27957 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:47.254730 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.251127 29043 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:47.268393 29007 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:47.277418 28952 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:47.278208 28952 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.279599 29159 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.281503 28952 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:47.283314 29026 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:47.286926 29121 consensus_queue.cc:1048] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:47.294515 28026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 63) took 1566 ms. Trace:
I20260503 07:57:47.296002 29123 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:57:47.294948 28026 rpcz_store.cc:276] 0503 07:57:45.727821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.341626 (+613805us) service_pool.cc:224] Handling call
0503 07:57:46.341926 (+ 300us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:57:46.342126 (+ 200us) raft_consensus.cc:1534] Early marking committed up to index 6
0503 07:57:46.342413 (+ 287us) log.cc:844] Serialized 14 byte log entry
0503 07:57:47.288424 (+946011us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b180026abe0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f85015fae1a 00007f850ac9c5c9 00007f85014b91f0 00007f8501683b24 00007f8501683a95 00007f8508127837 00007f850472ed87 00007f850473e49f 00007f850473e418
0503 07:57:47.288892 (+ 468us) log.cc:844] Serialized 14 byte log entry
0503 07:57:47.289268 (+ 376us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:57:47.289338 (+ 70us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:57:47.289436 (+ 98us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.294187 (+ 4751us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:47.294365 (+ 178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33166,"prepare.queue_time_us":758979,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":74,"raft.queue_time_us":36010,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5985,"spinlock_wait_cycles":21045888,"thread_start_us":146901,"threads_started":1,"wal-append.queue_time_us":255365}
I20260503 07:57:47.311237 28104 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:47.311844 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:47.313719 28107 raft_consensus.cc:1275] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:47.314833 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.318070 29311 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.330902 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 65) took 1090 ms. Trace:
I20260503 07:57:47.332484 29179 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.334189 29179 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.335129 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:47.335638 29159 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.335958 29123 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.336256 29159 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.336455 29179 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:47.333357 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:47.336387 29123 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.338299 29159 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.338708 29123 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.338083 28031 rpcz_store.cc:276] 0503 07:57:46.240814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.934599 (+693785us) service_pool.cc:224] Handling call
0503 07:57:46.934849 (+ 250us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:46.954478 (+ 19629us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:46.954508 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:46.981211 (+ 26703us) log.cc:844] Serialized 26 byte log entry
0503 07:57:47.109043 (+127832us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:57:47.327798 (+218755us) log.cc:844] Serialized 14 byte log entry
0503 07:57:47.330385 (+ 2587us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.330483 (+ 98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:47.330537 (+ 54us) raft_consensus.cc:1685] finished
0503 07:57:47.330547 (+ 10us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:47.330717 (+ 170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199531,"prepare.queue_time_us":181872,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":86669,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":24509,"thread_start_us":164823,"threads_started":2,"wal-append.queue_time_us":77501}
I20260503 07:57:47.340641 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.341818 29311 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.343358 29311 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.345176 29212 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:47.345546 29212 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:47.345878 29212 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.347585 28104 raft_consensus.cc:1240] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:47.348111 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.348703 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.349321 28108 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:47.348739 28103 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:47.350344 27957 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:47.353189 29311 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.362079 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:47.354025 29311 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.367164 27926 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.368978 28030 raft_consensus.cc:1240] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:47.369292 28035 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:47.369535 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.372555 29311 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.372105 27854 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:47.374197 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.375872 29183 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.376160 28030 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:47.381788 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.375874 27854 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:47.394652 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.395545 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.401793 29213 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:47.402107 28075 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.403244 29213 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:47.404556 29213 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.405215 28106 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:47.406791 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.407063 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.407506 27957 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:47.408422 28027 raft_consensus.cc:2393] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:47.408563 29071 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:47.409077 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 959) took 1819 ms. Trace:
I20260503 07:57:47.409953 29071 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.411032 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.433463 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.411823 28030 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:47.401497 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.447103 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.446738 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.454491 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 962) took 1598 ms. Trace:
I20260503 07:57:47.463527 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.448774 27854 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260503 07:57:47.468672 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.469550 28100 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:47.470366 29311 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.471099 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:47.471010 29311 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.472332 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.477560 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.478188 27956 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:47.475682 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.475024 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.455557 28032 rpcz_store.cc:276] 0503 07:57:45.849910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.385095 (+535185us) service_pool.cc:224] Handling call
0503 07:57:46.385437 (+ 342us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:46.385826 (+ 389us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:46.385864 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:46.386328 (+ 464us) log.cc:844] Serialized 26 byte log entry
0503 07:57:46.578254 (+191926us) raft_consensus.cc:1645] Marking committed up to 3
0503 07:57:47.391126 (+812872us) log.cc:844] Serialized 14 byte log entry
0503 07:57:47.440904 (+ 49778us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.441155 (+ 251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:47.441266 (+ 111us) raft_consensus.cc:1685] finished
0503 07:57:47.441283 (+ 17us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:47.448049 (+ 6766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":707016,"prepare.queue_time_us":708707,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":8238,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":34875,"thread_start_us":208964,"threads_started":2,"wal-append.queue_time_us":575220}
I20260503 07:57:47.481245 28035 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:47.474128 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.484690 29007 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.485299 29007 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.472939 29311 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.472824 29121 consensus_queue.cc:1059] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260503 07:57:47.486274 29311 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.473285 29183 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:47.486972 29183 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.485565 28103 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:47.487317 29007 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.483438 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.489499 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.492544 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.493333 28032 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:47.485590 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.487349 29183 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:47.504805 28026 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:47.502120 29121 consensus_queue.cc:1243] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer adaf84b6ac60420ab03d39b9db9f0413 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:47.409480 28028 rpcz_store.cc:276] 0503 07:57:45.589350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.320319 (+730969us) service_pool.cc:224] Handling call
0503 07:57:46.320594 (+ 275us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:57:46.339669 (+ 19075us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:57:46.343858 (+ 4189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:57:46.382497 (+ 38639us) log.cc:844] Serialized 26 byte log entry
0503 07:57:46.580165 (+197668us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:57:47.391518 (+811353us) log.cc:844] Serialized 14 byte log entry
0503 07:57:47.401194 (+ 9676us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:57:47.408699 (+ 7505us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:57:47.408759 (+ 60us) raft_consensus.cc:1685] finished
0503 07:57:47.408769 (+ 10us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:57:47.408896 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":703525,"prepare.queue_time_us":701145,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":14289,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":11265,"thread_start_us":238253,"threads_started":2,"wal-append.queue_time_us":616093}
I20260503 07:57:47.512751 29297 raft_consensus.cc:3055] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:47.513123 29297 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:47.515832 28031 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:47.476305 29212 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:47.496577 27854 catalog_manager.cc:5671] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:47.523988 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.524509 27955 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:57:47.526106 27854 catalog_manager.cc:5671] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:47.527679 27854 catalog_manager.cc:5671] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:47.529723 28102 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260503 07:57:47.529433 27854 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:47.532274 29297 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:47.533252 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 47784.7us
I20260503 07:57:47.533751 29297 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.537321 29078 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.537654 29212 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:47.538959 29078 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.539176 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:47.542572 28027 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:47.543886 29183 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.536307 27854 catalog_manager.cc:5671] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:47.551780 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.547719 29310 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:47.553285 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.553494 29310 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:47.553890 29310 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.553928 28102 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:47.545969 29053 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260503 07:57:47.551976 27854 catalog_manager.cc:5671] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:47.558521 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:57:47.563321 27923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:47.563674 28109 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:47.556643 29311 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.568397 29060 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:57:47.569470 29255 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260503 07:57:47.572926 29183 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.575501 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.576532 29310 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.578341 29310 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.585168 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.587232 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.591284 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.591804 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:47.593246 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.593936 27958 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:47.595041 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.605880 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.606818 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.607564 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.611835 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.613935 29053 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.617983 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.608829 29311 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:47.624788 28619 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 4 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:47.614007 29123 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.632301 27951 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:47.632429 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:47.622422 29053 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:47.634950 29053 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.635336 29053 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:47.636832 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.622987 29311 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.646831 29311 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:47.627262 29250 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260503 07:57:47.653435 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:47.653743 27924 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.654445 29064 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260503 07:57:47.655128 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.656057 29183 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:47.656436 29183 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:47.656785 29183 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.662576 29297 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:47.663331 29164 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:47.663662 29297 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:47.664120 29297 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.667233 29071 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.680707 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:47.682183 29164 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.695240 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.696506 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:47.697302 27956 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:47.697854 29313 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.700719 29064 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:47.718194 28073 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:47.731877 28073 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.733675 28952 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:47.754695 28073 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.753652 29316 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.756531 29252 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:47.757094 29252 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:47.757629 29252 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.756945 29316 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:47.762385 28075 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.763724 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.765166 29064 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:47.769896 29316 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:47.771243 29213 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:47.741699 29212 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260503 07:57:47.742769 29164 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.805051 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:47.786444 29213 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:47.817873 28035 raft_consensus.cc:1240] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:57:47.826589 29007 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:47.829222 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:47.829914 28101 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:47.831861 29164 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.834272 29183 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:47.835538 29340 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.118s user 0.001s sys 0.000s
I20260503 07:57:47.836520 29183 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.755597 29053 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.840669 29053 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.853785 29346 consensus_queue.cc:1059] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260503 07:57:47.854146 29196 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.854712 29196 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.821132 29043 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260503 07:57:47.857642 29123 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.858140 29123 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.859793 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.860186 29123 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.849052 29311 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.863416 29311 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.865706 29173 raft_consensus.cc:3055] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:47.866078 29173 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:47.866907 29173 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:47.868641 29252 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.872303 28104 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:47.873484 29252 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:47.873723 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:47.856882 29196 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.875466 29297 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:47.903409 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 111418us
I20260503 07:57:47.907866 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.909305 29141 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:47.909638 29043 consensus_queue.cc:1059] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:47.911397 29043 raft_consensus.cc:3055] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:47.911793 29043 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:47.914738 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:47.877683 29078 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:47.914222 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:47.945132 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 58640.1us
I20260503 07:57:47.949505 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:47.947993 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:47.948588 29316 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260503 07:57:47.925701 29078 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.930037 29196 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:47.912703 29043 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:47.956991 29078 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:47.956403 29316 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:47.967784 29196 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:47.975829 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 185387us
I20260503 07:57:47.970710 29297 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:47.963797 28101 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:47.967307 29053 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:57:47.977962 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 263566us
W20260503 07:57:47.976645 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 202658us
I20260503 07:57:47.974781 29064 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:47.988396 27924 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:47.975895 29316 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.094108 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:48.096410 27924 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.095511 28034 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:48.109202 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:48.084614 28026 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:48.112334 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:48.082226 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:48.119076 27924 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:47.991381 29053 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:48.122473 29297 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260503 07:57:48.125514 29318 log.cc:927] Time spent T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.100s user 0.000s sys 0.000s
W20260503 07:57:48.126085 29358 log.cc:927] Time spent T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.104s user 0.000s sys 0.000s
I20260503 07:57:48.126161 29345 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:48.148088 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:48.162940 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 43936.5us
I20260503 07:57:48.131523 29345 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:48.179344 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:48.183045 27958 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:48.173827 27952 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260503 07:57:48.214612 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 50180.7us
I20260503 07:57:48.171603 29311 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:48.179240 29297 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:57:48.186208 29345 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:48.235646 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.242511 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:48.243830 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:48.244396 28107 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:48.223613 29053 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.262171 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:48.236274 29311 raft_consensus.cc:697] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:48.247041 28952 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:48.239037 29196 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.238406 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:48.247179 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:48.255259 29313 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:48.258880 29310 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:48.271245 29311 consensus_queue.cc:237] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.266716 29053 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260503 07:57:48.291584 29359 log.cc:927] Time spent T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.170s user 0.000s sys 0.001s
I20260503 07:57:48.293489 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:48.294027 29313 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.282501 28952 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.296617 28107 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:48.284049 28028 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:57:48.305349 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:48.288792 29316 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.310702 29213 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260503 07:57:48.311070 29301 log.cc:927] Time spent T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.051s user 0.000s sys 0.001s
I20260503 07:57:48.307876 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.297250 29053 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:48.321622 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.322918 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.325088 27952 raft_consensus.cc:1240] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:48.330399 27926 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.331260 29353 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:48.331493 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.332641 29353 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:57:48.343686 27926 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:48.335477 29053 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:48.359359 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.387804 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.388309 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:48.389591 27957 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260503 07:57:48.390064 27957 pending_rounds.cc:85] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Aborting all ops after (but not including) 1
I20260503 07:57:48.390324 27957 pending_rounds.cc:107] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260503 07:57:48.390734 27957 raft_consensus.cc:2889] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:48.395362 29196 consensus_queue.cc:1059] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:57:48.349445 28952 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:48.397516 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.353721 29350 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:48.403999 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.413671 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.414850 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.419337 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.418532 29316 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:48.412797 29350 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:48.421355 29310 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:57:48.419682 29123 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:48.433089 29350 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:48.481653 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.443173 29173 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:48.444897 29310 consensus_queue.cc:1059] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260503 07:57:48.449354 27953 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:48.493958 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:48.497861 28101 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
W20260503 07:57:48.499125 29363 log.cc:927] Time spent T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.520s user 0.004s sys 0.000s
W20260503 07:57:48.499500 28075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s user 0.000s sys 0.032s
W20260503 07:57:48.499904 28075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s user 0.000s sys 0.032s
W20260503 07:57:48.505470 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 529191us
I20260503 07:57:48.514606 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.486488 29123 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:48.522644 29123 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.524325 29123 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.524089 29053 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.526067 27958 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:48.526072 28028 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:48.526083 29053 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.530736 28992 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:57:48.531266 29316 raft_consensus.cc:3055] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:48.536890 29316 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:48.538143 29043 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:48.537843 29316 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.539409 29316 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:48.532847 29196 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:57:48.533351 29315 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:48.541965 28027 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:48.453177 29313 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:48.536917 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:57:48.568192 29385 log.cc:927] Time spent T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.210s user 0.001s sys 0.000s
I20260503 07:57:48.569988 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:57:48.575287 29078 consensus_meta.cc:287] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.598s user 0.008s sys 0.001s
I20260503 07:57:48.575663 29078 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.576609 28030 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:48.582221 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:48.584009 29043 consensus_queue.cc:1059] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260503 07:57:48.587401 29078 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:48.591511 29388 log.cc:927] Time spent T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.091s user 0.002s sys 0.001s
I20260503 07:57:48.607695 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.637931 27924 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.645248 29353 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:48.646793 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.647141 29345 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.648655 27951 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:48.650255 29043 raft_consensus.cc:3055] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:48.650650 29043 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:48.654220 28073 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:48.655663 29345 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.655849 29071 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:48.658494 29374 consensus_queue.cc:1059] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:48.659583 29374 raft_consensus.cc:3055] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:48.659896 29374 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:48.655668 29164 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:57:48.651314 29043 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.660517 29071 raft_consensus.cc:697] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:48.698635 29043 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:48.684494 28992 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:48.699610 28992 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:48.708276 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 175798us
I20260503 07:57:48.720714 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:48.721197 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.725970 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:57:48.697144 29179 consensus_queue.cc:1175] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "37e72845941344c9b0aaa7235a6f4473" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 3 index: 3 } }
I20260503 07:57:48.734236 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:48.734477 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
W20260503 07:57:48.751569 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:48.755914 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.758991 27954 raft_consensus.cc:2393] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:48.754613 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:48.732298 28992 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.735497 29078 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:48.772029 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:48.740444 29315 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:48.743194 29346 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:48.781219 29078 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.777060 29393 consensus_queue.cc:1059] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260503 07:57:48.785247 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:48.788370 28031 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
W20260503 07:57:48.785881 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 465481us
I20260503 07:57:48.788293 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:48.775571 29313 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:48.797219 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:48.756193 29212 consensus_queue.cc:1059] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260503 07:57:48.780200 29315 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:48.738106 29374 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.746356 29071 consensus_queue.cc:237] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.805315 29064 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:48.809830 29315 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:48.804011 29212 raft_consensus.cc:3055] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:48.819944 29060 raft_consensus.cc:3055] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:48.821298 29064 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:48.824867 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.801123 29346 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.804159 29313 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:48.830303 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:48.830622 29370 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:48.824612 29212 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:48.834527 29064 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.836644 29400 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:48.828311 29374 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:48.837224 27951 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:48.852572 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:48.824791 29350 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.842231 28108 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:48.833616 29401 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:48.849821 28034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28731014d42b4316af0150b0e98f6152"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:48.861985 28034 raft_consensus.cc:606] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:48.862330 28034 raft_consensus.cc:614] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:57:48.825039 29060 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:48.851800 27957 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260503 07:57:48.921662 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 56316.9us
W20260503 07:57:48.924186 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 45555.3us
I20260503 07:57:48.927343 29060 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.928109 29350 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.927879 29212 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:48.929416 29212 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:48.933246 29400 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:48.936672 29400 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.938436 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
W20260503 07:57:48.940738 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 79908.3us
I20260503 07:57:48.941851 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:48.945511 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 77682.5us
I20260503 07:57:48.962250 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:48.946206 29313 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:48.946709 29311 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:48.853310 29370 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:48.948649 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:48.965669 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:48.966383 28101 raft_consensus.cc:2368] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:48.966532 29053 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:48.966708 29370 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:48.966971 29053 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:48.967377 29053 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:48.947115 27952 raft_consensus.cc:2368] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:48.969627 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:48.969928 29310 consensus_queue.cc:1059] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:48.865419 29316 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:57:48.870990 29064 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:48.957479 29078 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.963335 28075 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:48.964816 29311 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:48.954499 29346 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:48.974015 28107 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:48.982026 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:48.987514 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:48.987133 27957 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:48.990257 28034 raft_consensus.cc:2393] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:48.998668 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:48.998813 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:48.999823 27924 leader_election.cc:400] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:49.000129 27924 leader_election.cc:403] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:57:49.001085 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:49.004333 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:49.007761 29078 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:49.004287 29310 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:49.010783 29240 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:49.010689 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:49.013458 29060 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.019807 29078 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:48.990000 29370 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:57:49.032410 29164 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3.
I20260503 07:57:49.000761 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.045287 29315 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.047200 29315 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:49.059571 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 64415.7us
W20260503 07:57:49.084070 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 64128.3us
I20260503 07:57:49.088056 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.088600 28107 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.091574 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.092818 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:49.096380 29078 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.098642 29311 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:49.101016 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:49.101713 28106 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:49.102943 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:49.102293 29252 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.102737 28027 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.105844 29053 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.108604 28107 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
W20260503 07:57:49.117090 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 112637us
I20260503 07:57:49.118443 29053 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.107370 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:49.119473 28103 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:49.116209 29007 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:49.121531 28585 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.122825 29245 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:57:49.124424 28030 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:57:49.089851 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:49.121470 29007 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:49.129171 29007 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.134683 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:49.135313 27957 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:49.138767 29240 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:49.142560 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:49.142984 29240 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:49.143246 27957 raft_consensus.cc:2393] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 2: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:49.147802 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:49.148484 29060 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:57:49.150326 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:49.151068 29316 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:49.151417 29316 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:49.151793 29316 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.153909 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.161675 27951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45176 (request call id 800) took 1079 ms. Trace:
I20260503 07:57:49.162077 27951 rpcz_store.cc:276] 0503 07:57:48.082054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:48.094611 (+ 12557us) service_pool.cc:224] Handling call
0503 07:57:48.536820 (+442209us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800000998. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649a3e 000000000035a3c9 00007f85096818e0 00007f850974a784 00007f850974a7f1 00007f85096f8760 00007f85096f8044 00007f8502c65834 00007f8502c657c2
0503 07:57:49.161472 (+624652us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b5400303754. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:57:49.161601 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229033088}
I20260503 07:57:49.166127 27960 raft_consensus.cc:1275] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:49.167253 27999 leader_election.cc:400] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3.
I20260503 07:57:49.171813 28109 raft_consensus.cc:1275] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:49.182930 27924 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.184019 29347 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:49.184451 29347 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:49.185418 29347 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.188310 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:49.191057 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.194068 29316 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:49.195799 29316 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:49.195967 28104 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:49.196148 28028 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:49.197342 28073 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.209296 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:49.197221 29412 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:49.207768 29240 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.212419 29240 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:49.177392 29173 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260503 07:57:49.216033 29173 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:57:49.216341 29173 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:49.217152 29173 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.218233 29173 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:49.220544 29412 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:57:49.225683 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.235229 27960 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:49.229079 27924 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.242338 28104 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:57:49.241680 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:49.246192 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:49.250471 29053 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:49.200165 29078 consensus_queue.cc:1048] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260503 07:57:49.253991 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.256568 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.252348 29362 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:57:49.259266 29395 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:49.268503 29362 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:49.254591 29053 raft_consensus.cc:697] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:49.268934 29362 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:49.256317 29060 consensus_queue.cc:1048] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260503 07:57:49.268986 29395 raft_consensus.cc:697] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:49.270702 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:49.273649 28103 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:49.269822 29053 consensus_queue.cc:237] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:49.273941 29395 consensus_queue.cc:237] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.279317 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:49.284132 27857 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 1 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 4 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.287015 27857 catalog_manager.cc:5671] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.288090 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33434 (request call id 182) took 4647 ms. Trace:
I20260503 07:57:49.289849 27857 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 2 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:49.291632 27857 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 2 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.288520 27854 rpcz_store.cc:276] 0503 07:57:44.640486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.640624 (+ 138us) service_pool.cc:224] Handling call
0503 07:57:49.288025 (+4647401us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:57:47.954154 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:57:48.179960 (+225806us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:57:48.195072 (+ 15112us) write_op.cc:435] Acquired schema lock
0503 07:57:48.215673 (+ 20601us) tablet.cc:662] Decoding operations
0503 07:57:48.447650 (+231977us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:57:48.483600 (+ 35950us) write_op.cc:641] Partition lock acquired for write op
0503 07:57:48.483643 (+ 43us) tablet.cc:685] Acquiring locks for 9 operations
0503 07:57:48.484444 (+ 801us) tablet.cc:701] Row locks acquired
0503 07:57:48.484486 (+ 42us) write_op.cc:260] PREPARE: finished
0503 07:57:48.484639 (+ 153us) write_op.cc:270] Start()
0503 07:57:48.484761 (+ 122us) write_op.cc:276] Timestamp: P: 1777795068484588 usec, L: 0
0503 07:57:48.484806 (+ 45us) op_driver.cc:348] REPLICATION: starting
0503 07:57:48.485379 (+ 573us) log.cc:844] Serialized 3703 byte log entry
0503 07:57:49.048867 (+563488us) op_driver.cc:464] REPLICATION: finished
0503 07:57:49.178257 (+129390us) write_op.cc:301] APPLY: starting
0503 07:57:49.181445 (+ 3188us) tablet.cc:1367] starting BulkCheckPresence
0503 07:57:49.196458 (+ 15013us) tablet.cc:1370] finished BulkCheckPresence
0503 07:57:49.197860 (+ 1402us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:57:49.206694 (+ 8834us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:57:49.206987 (+ 293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0503 07:57:49.207042 (+ 55us) write_op.cc:312] APPLY: finished
0503 07:57:49.207333 (+ 291us) log.cc:844] Serialized 70 byte log entry
0503 07:57:49.207516 (+ 183us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:49.207639 (+ 123us) write_op.cc:454] Released schema lock
0503 07:57:49.207698 (+ 59us) write_op.cc:341] FINISH: Updating metrics
0503 07:57:49.221445 (+ 13747us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:49.221474 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":806849,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":80618,"apply.run_cpu_time_us":3800,"apply.run_wall_time_us":48043,"num_ops":9,"prepare.queue_time_us":373098,"prepare.run_cpu_time_us":76967,"prepare.run_wall_time_us":774599,"raft.queue_time_us":198553,"raft.run_cpu_time_us":7011,"raft.run_wall_time_us":131125,"replication_time_us":516094,"thread_start_us":678653,"threads_started":4,"wal-append.queue_time_us":260366}]]}
I20260503 07:57:49.294313 27857 catalog_manager.cc:5671] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 1 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 3 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.297628 29347 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:49.317888 28073 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.317782 29347 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:49.332818 29141 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:57:49.335564 29347 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:49.339838 28619 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.353128 29347 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:49.367901 29362 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.346182 29395 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:49.375921 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.377800 29164 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:49.378263 29164 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.380098 29164 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.377359 29395 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.382897 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:49.384065 28028 raft_consensus.cc:2393] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:49.384227 29395 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.384388 29347 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.386627 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:43212
I20260503 07:57:49.387243 28103 raft_consensus.cc:606] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Received request to transfer leadership
I20260503 07:57:49.388157 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:49.388185 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:49.389093 27953 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:49.389277 28100 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:49.390288 29362 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.390945 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.394387 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:49.395038 29395 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:49.395349 29395 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:49.395622 29395 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.404647 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53082 (request call id 60) took 3183 ms. Trace:
I20260503 07:57:49.407362 29395 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.438190 28030 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:49.438407 29395 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.421749 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:49.434263 27857 rpcz_store.cc:276] 0503 07:57:46.220918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:46.223464 (+ 2546us) service_pool.cc:224] Handling call
0503 07:57:49.404578 (+3181114us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:57:49.342156 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:57:49.342716 (+ 560us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:57:49.342754 (+ 38us) write_op.cc:435] Acquired schema lock
0503 07:57:49.342775 (+ 21us) tablet.cc:662] Decoding operations
0503 07:57:49.343437 (+ 662us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:57:49.343513 (+ 76us) write_op.cc:641] Partition lock acquired for write op
0503 07:57:49.343539 (+ 26us) tablet.cc:685] Acquiring locks for 5 operations
0503 07:57:49.344043 (+ 504us) tablet.cc:701] Row locks acquired
0503 07:57:49.344060 (+ 17us) write_op.cc:260] PREPARE: finished
0503 07:57:49.344194 (+ 134us) write_op.cc:270] Start()
0503 07:57:49.344298 (+ 104us) write_op.cc:276] Timestamp: P: 1777795069344149 usec, L: 0
0503 07:57:49.344318 (+ 20us) op_driver.cc:348] REPLICATION: starting
0503 07:57:49.344934 (+ 616us) log.cc:844] Serialized 2160 byte log entry
0503 07:57:49.357045 (+ 12111us) op_driver.cc:464] REPLICATION: finished
0503 07:57:49.357421 (+ 376us) write_op.cc:301] APPLY: starting
0503 07:57:49.357490 (+ 69us) tablet.cc:1367] starting BulkCheckPresence
0503 07:57:49.357627 (+ 137us) tablet.cc:1370] finished BulkCheckPresence
0503 07:57:49.357717 (+ 90us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:57:49.358309 (+ 592us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:57:49.358473 (+ 164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0503 07:57:49.358515 (+ 42us) write_op.cc:312] APPLY: finished
0503 07:57:49.358717 (+ 202us) log.cc:844] Serialized 46 byte log entry
0503 07:57:49.358850 (+ 133us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:49.358940 (+ 90us) write_op.cc:454] Released schema lock
0503 07:57:49.358977 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0503 07:57:49.359311 (+ 334us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:49.359338 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57610,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":199,"apply.run_cpu_time_us":1827,"apply.run_wall_time_us":1826,"num_ops":5,"prepare.queue_time_us":41691,"prepare.run_cpu_time_us":3072,"prepare.run_wall_time_us":3073,"replication_time_us":12592,"thread_start_us":37184,"threads_started":1}]]}
I20260503 07:57:49.423107 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.425302 28109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:43212
I20260503 07:57:49.426584 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77488bc798a841d697b108fb23d5531b"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:49.432459 29179 raft_consensus.cc:993] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower 25017111886b42cfa5701a39de59b6ad to start an election
I20260503 07:57:49.439121 28100 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:49.422724 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.440127 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:49.456233 27953 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.441555 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.442572 29412 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:49.458878 28102 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:49.449661 27856 catalog_manager.cc:5671] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.455580 28109 raft_consensus.cc:606] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Received request to transfer leadership
I20260503 07:57:49.460314 29240 raft_consensus.cc:1081] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Signalling peer 25017111886b42cfa5701a39de59b6ad to start an election
W20260503 07:57:49.462668 27842 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 3d2e3ed8ebbe4d968d5ab9e678ea1561 already in progress [suppressed 31 similar messages]
I20260503 07:57:49.463759 27924 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.464100 27856 catalog_manager.cc:5671] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.468216 27856 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.463617 28619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561"
dest_uuid: "25017111886b42cfa5701a39de59b6ad"
from {username='slave'} at 127.0.0.1:51168
I20260503 07:57:49.470629 27856 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.472028 29347 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:49.473727 29347 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:49.474076 29347 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.477110 28619 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:49.477512 28619 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:49.467197 28103 raft_consensus.cc:606] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.482467 27856 catalog_manager.cc:5671] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.488989 28103 raft_consensus.cc:614] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:57:49.490890 27856 catalog_manager.cc:5671] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.492318 28028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:49.492969 28028 raft_consensus.cc:606] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.492311 27856 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.494385 27856 catalog_manager.cc:5671] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.496364 27856 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.498633 27856 catalog_manager.cc:5671] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.488579 28619 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:49.499612 27856 catalog_manager.cc:5671] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.501600 28028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:49.501742 29347 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.502219 28028 raft_consensus.cc:606] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.502642 28028 raft_consensus.cc:614] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:57:49.502099 27856 catalog_manager.cc:5671] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 2 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.503660 27856 catalog_manager.cc:5671] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.497310 27953 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:49.504647 27856 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.508561 27951 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:49.508581 28028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:49.509891 28104 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:49.512562 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.513496 29347 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.513432 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:49.504665 28102 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:49.515934 27924 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.512876 28028 raft_consensus.cc:606] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.514838 27856 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.516505 29395 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:49.519709 27924 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.514371 29179 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260503 07:57:49.517786 29345 raft_consensus.cc:2764] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260503 07:57:49.517738 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.521056 27856 catalog_manager.cc:5671] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } }
I20260503 07:57:49.519265 28028 raft_consensus.cc:614] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:57:49.521298 29347 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:49.524488 28103 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.522035 29395 raft_consensus.cc:697] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:49.525856 29395 consensus_queue.cc:237] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.527872 29347 raft_consensus.cc:697] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:49.529111 29347 consensus_queue.cc:237] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:49.534075 28103 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:49.535698 27924 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.536602 29353 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:49.537045 29353 raft_consensus.cc:697] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:49.537786 29353 consensus_queue.cc:237] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.538115 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:49.538686 28030 raft_consensus.cc:606] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.539024 28030 raft_consensus.cc:614] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:57:49.540084 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260503 07:57:49.540230 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:49.540768 27953 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:49.541682 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:49.550078 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:49.556267 28619 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.564462 28104 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 4. Ops: []
I20260503 07:57:49.542472 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:43212
I20260503 07:57:49.565567 28102 raft_consensus.cc:606] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Received request to transfer leadership
I20260503 07:57:49.565934 29310 consensus_queue.cc:1059] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:49.566675 29395 raft_consensus.cc:3055] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:49.566998 29395 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:49.567021 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.567750 28030 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:49.567878 29395 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.569118 29395 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 4
I20260503 07:57:49.576768 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.577534 28102 raft_consensus.cc:3055] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:57:49.577914 28102 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:49.579170 28102 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:49.581079 28102 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:49.592357 27857 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 2 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.629947 27856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 195) took 1339 ms. Trace:
I20260503 07:57:49.630335 27856 rpcz_store.cc:276] 0503 07:57:48.290070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:48.290421 (+ 351us) service_pool.cc:224] Handling call
0503 07:57:49.628983 (+1338562us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:57:49.559576 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:57:49.560218 (+ 642us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:57:49.560259 (+ 41us) write_op.cc:435] Acquired schema lock
0503 07:57:49.560303 (+ 44us) tablet.cc:662] Decoding operations
0503 07:57:49.561940 (+ 1637us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:57:49.562003 (+ 63us) write_op.cc:641] Partition lock acquired for write op
0503 07:57:49.562046 (+ 43us) tablet.cc:685] Acquiring locks for 16 operations
0503 07:57:49.563529 (+ 1483us) tablet.cc:701] Row locks acquired
0503 07:57:49.563549 (+ 20us) write_op.cc:260] PREPARE: finished
0503 07:57:49.563731 (+ 182us) write_op.cc:270] Start()
0503 07:57:49.563865 (+ 134us) write_op.cc:276] Timestamp: P: 1777795069563670 usec, L: 0
0503 07:57:49.563886 (+ 21us) op_driver.cc:348] REPLICATION: starting
0503 07:57:49.564590 (+ 704us) log.cc:844] Serialized 6317 byte log entry
0503 07:57:49.576305 (+ 11715us) op_driver.cc:464] REPLICATION: finished
0503 07:57:49.579101 (+ 2796us) write_op.cc:301] APPLY: starting
0503 07:57:49.579174 (+ 73us) tablet.cc:1367] starting BulkCheckPresence
0503 07:57:49.579480 (+ 306us) tablet.cc:1370] finished BulkCheckPresence
0503 07:57:49.579575 (+ 95us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:57:49.580994 (+ 1419us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:57:49.581254 (+ 260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0503 07:57:49.581298 (+ 44us) write_op.cc:312] APPLY: finished
0503 07:57:49.581625 (+ 327us) log.cc:844] Serialized 112 byte log entry
0503 07:57:49.581791 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:49.581930 (+ 139us) write_op.cc:454] Released schema lock
0503 07:57:49.581977 (+ 47us) write_op.cc:341] FINISH: Updating metrics
0503 07:57:49.583930 (+ 1953us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:57:49.583966 (+ 36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":2067,"apply.run_cpu_time_us":3162,"apply.run_wall_time_us":3162,"num_ops":16,"prepare.queue_time_us":142,"prepare.run_cpu_time_us":5382,"prepare.run_wall_time_us":16214,"replication_time_us":11482}]]}
I20260503 07:57:49.655587 28030 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:57:49.656057 28103 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:49.659607 29395 raft_consensus.cc:993] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:49.660005 29196 raft_consensus.cc:1081] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:49.661619 27954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:57:49.662166 27954 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:49.662492 27954 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:49.671519 27953 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:57:49.674113 28102 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:57:49.679309 29347 consensus_queue.cc:1059] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:49.668854 27954 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.682768 28585 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:49.684267 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.684890 28103 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:49.683066 27954 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.685918 29410 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:57:49.686045 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.686529 29410 raft_consensus.cc:697] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:49.686664 28030 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:57:49.687053 28030 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:49.687547 29410 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:49.694100 27954 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:49.697638 28100 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:49.704816 29196 consensus_queue.cc:1059] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:49.705457 29310 raft_consensus.cc:3055] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:49.705859 29310 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:49.706369 28035 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:49.706570 29310 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:49.707603 29345 consensus_queue.cc:1059] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:49.707795 29310 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:49.708254 29345 consensus_queue.cc:1243] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer adaf84b6ac60420ab03d39b9db9f0413 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:49.712028 29353 raft_consensus.cc:3055] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:49.712395 29353 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:49.713173 29353 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.714280 29353 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:49.702121 29395 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260503 07:57:49.716061 29395 consensus_queue.cc:1243] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:49.716490 29395 raft_consensus.cc:3055] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:49.716782 29395 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:49.717355 28030 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:49.718276 27905 auto_rebalancer.cc:806] Removing replace marker failed: Replica be26cebb7c90445ea9a74f66463457c1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:57:49.718730 27905 auto_rebalancer.cc:814] Could not move replica: Remote error: Service unavailable: leadership transfer for 3d2e3ed8ebbe4d968d5ab9e678ea1561 already in progress
I20260503 07:57:49.718792 28030 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:57:49.719053 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 3d2e3ed8ebbe4d968d5ab9e678ea1561 already in progress
I20260503 07:57:49.717549 29395 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.726823 29395 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.738463 28103 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:49.740940 27924 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:49.742954 29353 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:57:49.743654 29353 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:49.744495 29353 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.748576 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 180) took 5122 ms. Trace:
I20260503 07:57:49.750097 27854 catalog_manager.cc:5671] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.750869 27855 rpcz_store.cc:276] 0503 07:57:44.626226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:44.629373 (+ 3147us) service_pool.cc:224] Handling call
0503 07:57:49.748396 (+5119023us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":807988,"reported_tablets":28}
I20260503 07:57:49.752748 27854 catalog_manager.cc:5671] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.756646 27854 catalog_manager.cc:5671] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.758816 27854 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.761391 27854 catalog_manager.cc:5671] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.763890 27854 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.770735 28030 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:49.779866 27856 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 4 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.820830 27953 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:49.836261 29361 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:49.836730 29361 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.839635 29361 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:49.841707 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:49.842423 27954 raft_consensus.cc:2393] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:49.840792 27857 catalog_manager.cc:5671] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.846012 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:49.846691 28028 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:49.846364 27857 catalog_manager.cc:5671] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.848729 28075 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.854717 27857 catalog_manager.cc:5671] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.856559 27857 catalog_manager.cc:5671] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 2 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.858289 29240 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:49.860407 29240 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:49.860780 29240 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:49.867964 29240 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.870785 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:49.871469 27954 raft_consensus.cc:2393] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:49.893558 29240 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:49.896256 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.900816 28619 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:49.902370 29353 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:49.902662 28030 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:49.914563 27854 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.916422 27854 catalog_manager.cc:5671] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:49.917303 28075 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:49.921545 29179 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:49.921954 29179 raft_consensus.cc:697] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:49.922807 28030 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:49.922715 29179 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.924036 29347 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:49.926994 27854 catalog_manager.cc:5671] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:49.930198 29353 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:49.930809 29353 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.932715 29353 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.934551 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:49.935135 28103 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:49.936137 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:49.936929 29347 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:49.937337 29347 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:49.937736 29347 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:49.938570 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:49.940286 28035 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:49.948189 28035 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260503 07:57:49.948501 28035 pending_rounds.cc:85] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 1
I20260503 07:57:49.948715 28035 pending_rounds.cc:107] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260503 07:57:49.948921 28035 raft_consensus.cc:2889] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:49.954119 29353 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:49.963172 29362 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.964756 28102 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:49.962072 29347 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.966068 27855 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:49.967868 29347 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:49.968381 29353 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:49.968492 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:49.970821 28035 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:49.974795 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:49.976245 28619 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:49.979331 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 4029065128b84be9a45c0bfe2af75b6f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:49.982185 28104 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:49.983919 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:49.984942 29362 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:49.985558 29362 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:49.990792 29362 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:49.998948 29240 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:49.999496 29240 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.001266 29240 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:50.001891 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:50.006148 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:50.006697 28035 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:50.010566 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:50.011610 29179 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:50.011946 29179 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:50.012249 29179 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.036530 28027 raft_consensus.cc:2955] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:50.041644 28035 raft_consensus.cc:1275] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260503 07:57:50.042004 28035 pending_rounds.cc:85] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 2
I20260503 07:57:50.042261 28035 pending_rounds.cc:107] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260503 07:57:50.042472 28035 raft_consensus.cc:2889] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:50.057507 29347 consensus_queue.cc:1048] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:50.063915 28103 raft_consensus.cc:1275] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:50.065179 29347 consensus_queue.cc:1048] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:50.069859 27856 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 4 to 5, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:50.081564 27954 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:57:50.082825 29410 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:50.086061 28098 tablet_service.cc:1558] Processing DeleteTablet for tablet 4029065128b84be9a45c0bfe2af75b6f with delete_type TABLET_DATA_TOMBSTONED (TS be26cebb7c90445ea9a74f66463457c1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43212
I20260503 07:57:50.089300 28104 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:57:50.090711 29410 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:50.099640 29347 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:50.100379 29442 tablet_replica.cc:333] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: stopping tablet replica
I20260503 07:57:50.100123 29347 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.102881 29347 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.104012 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:50.104547 28104 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:50.107029 27924 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:50.108271 29347 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:50.108667 29347 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:50.109043 29347 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.111006 28104 consensus_queue.cc:237] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:50.112744 28103 consensus_queue.cc:237] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:50.126240 28109 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:50.146917 27855 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 2 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:50.156361 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:50.157965 29442 raft_consensus.cc:2243] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:50.158771 29442 raft_consensus.cc:2272] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:50.162811 28109 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:50.164616 29310 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:50.170157 29442 ts_tablet_manager.cc:1916] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:50.171550 29361 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:50.172066 27951 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:57:50.172010 29361 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.174165 29361 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:50.141173 29179 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.175717 28101 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:57:50.176010 29179 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:50.179185 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:50.180361 29362 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:50.180825 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:50.184207 28030 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:57:50.185760 29410 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:50.190706 27854 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:50.168098 29347 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.231784 29362 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:50.246004 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:50.246582 28033 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.225214 29395 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260503 07:57:50.247531 28035 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:57:50.250299 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:50.250869 28026 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:50.256628 29347 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.265337 28033 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:57:50.270725 29442 ts_tablet_manager.cc:1929] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260503 07:57:50.271351 29442 log.cc:1199] T 4029065128b84be9a45c0bfe2af75b6f P be26cebb7c90445ea9a74f66463457c1: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/wals/4029065128b84be9a45c0bfe2af75b6f
I20260503 07:57:50.295306 29395 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:50.248077 29173 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:50.295800 29395 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.296361 29173 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.297523 29395 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.248878 29362 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.278594 27842 catalog_manager.cc:5002] TS be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): tablet 4029065128b84be9a45c0bfe2af75b6f (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:50.303030 29362 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.320459 28075 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:50.324363 28619 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:50.328733 28614 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:50.333880 27951 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:57:50.335088 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:50.335727 28101 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:50.337314 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:50.338054 29395 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:50.338415 29395 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:50.338742 29395 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:50.341790 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:50.343977 29141 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:50.344327 29361 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
W20260503 07:57:50.346083 29446 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.088s user 0.000s sys 0.001s
I20260503 07:57:50.344323 29141 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:50.347370 29141 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.353648 29173 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:50.355365 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 106903us
I20260503 07:57:50.358566 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:50.359226 28035 raft_consensus.cc:2393] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:50.359933 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:50.360615 28033 raft_consensus.cc:2368] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5.
I20260503 07:57:50.357175 29361 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:50.360414 29347 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:50.376123 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:50.378705 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:50.376477 29347 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.393868 29452 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:50.443344 27926 leader_election.cc:400] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5.
I20260503 07:57:50.443655 27926 leader_election.cc:403] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:57:50.438727 27952 raft_consensus.cc:2368] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:57:50.424757 29395 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.430845 29361 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.429245 29141 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.437399 29452 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.456938 29452 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:50.457118 29141 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:50.454255 29456 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.451025 29461 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260503 07:57:50.459884 29196 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:50.460489 29196 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.462039 29395 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.462739 29196 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.463263 29347 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.467278 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:50.467914 28104 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:50.468864 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:50.469477 28035 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:50.469493 28026 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:50.466176 28028 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.479084 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:50.480324 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:50.480974 28035 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.498296 28035 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:57:50.503469 28102 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:50.513762 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:57:50.514592 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 71383.3us
I20260503 07:57:50.515560 28075 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:50.518122 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:50.520994 28027 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:57:50.523862 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:50.525252 27999 leader_election.cc:400] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:57:50.531400 28075 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:50.519236 29456 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5.
I20260503 07:57:50.524884 29196 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:50.538440 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:50.546038 27954 raft_consensus.cc:2368] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:57:50.533249 29179 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260503 07:57:50.549098 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:50.545363 29452 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:57:50.549679 27953 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:50.553205 29196 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:50.553624 29196 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:50.533562 29240 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:50.554373 29240 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:50.554738 29240 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:50.561393 28026 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:50.564849 29452 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:50.568053 29452 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.577491 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:50.578703 29179 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:50.581668 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:50.582204 28100 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:50.583714 29196 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.584774 28033 raft_consensus.cc:2393] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:50.589943 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:50.592283 29345 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:50.594512 28028 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:50.594694 27999 leader_election.cc:400] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:57:50.595053 29453 raft_consensus.cc:2764] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260503 07:57:50.598201 29453 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:50.598644 29453 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.598208 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:50.610164 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:50.622277 27954 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:50.619697 29456 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:57:50.625283 29456 raft_consensus.cc:697] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:50.626124 29456 consensus_queue.cc:237] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.610064 29453 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.630080 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:50.630748 27956 raft_consensus.cc:2393] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:57:50.635723 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:50.636368 27954 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 5
W20260503 07:57:50.638101 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 73271.2us
I20260503 07:57:50.674094 27924 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:50.676486 27954 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:57:50.681646 29452 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260503 07:57:50.682777 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:50.690675 29196 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:50.692341 29353 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:50.694300 29240 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.696178 29240 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:57:50.698002 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 95666.9us
I20260503 07:57:50.711493 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:50.712131 27954 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:50.726109 27954 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:50.719986 27854 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:50.735216 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:50.735932 28103 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:50.738379 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:50.738947 28102 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
W20260503 07:57:50.743944 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 76853.3us
I20260503 07:57:50.750231 29477 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:50.754078 28100 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:50.755892 28103 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:50.898852 27855 catalog_manager.cc:5671] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:50.757488 29466 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:50.912456 29466 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:50.949195 29466 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:50.971354 29478 log.cc:927] Time spent T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.220s user 0.000s sys 0.001s
W20260503 07:57:50.977453 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 265994us
W20260503 07:57:50.989614 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 238457us
I20260503 07:57:50.991521 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:51.001613 29466 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:51.002226 29466 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.004508 29466 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.011178 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:50.997704 29453 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:51.019073 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:51.036875 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:51.037555 27951 raft_consensus.cc:2368] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:57:51.023622 29453 raft_consensus.cc:697] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:51.022687 29179 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260503 07:57:51.039060 29487 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260503 07:57:51.050660 28108 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:51.052415 29453 consensus_queue.cc:237] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.061709 28026 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.063400 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:51.063990 28109 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:51.078491 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:51.082216 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:51.083220 28106 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.084213 28103 raft_consensus.cc:2393] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:51.085794 29466 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260503 07:57:51.087242 27924 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:51.097997 27959 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.097918 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:51.099627 29173 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:57:51.099975 29173 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:51.100291 29173 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.101279 29345 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:51.102842 29345 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:51.063149 29240 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.128351 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:51.129967 29483 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:51.130311 29483 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:51.130676 29483 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:51.127976 29345 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:51.134902 29345 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.127490 28026 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.138028 29345 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.107823 29173 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.149417 28619 raft_consensus.cc:2955] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.151191 28073 leader_election.cc:400] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:57:51.151640 28073 leader_election.cc:403] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260503 07:57:51.152261 29361 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:57:51.159201 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:51.160210 27926 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:51.159865 28102 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:51.162492 27924 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:51.164742 29345 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:51.165112 29345 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:57:51.165407 29345 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:51.170258 29361 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:51.179013 29345 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.180408 29345 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.181035 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:51.181318 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.181571 28030 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:51.181938 28102 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:51.198937 28102 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:51.199977 27924 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:51.203130 29173 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.206502 29353 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:57:51.206367 29141 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:51.207824 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.210222 28102 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.212869 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:51.213551 28033 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:51.215550 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:51.216003 28033 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:51.219480 28031 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.224860 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:51.225535 28030 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.228503 27954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:57:51.229435 27954 raft_consensus.cc:606] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:51.229797 27956 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.209599 29353 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:51.220211 29466 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:51.236436 28033 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:51.274643 28102 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:57:51.279032 28026 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.287477 29498 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:51.287974 29498 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:51.284878 28030 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:57:51.290494 29498 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:51.236620 29457 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
W20260503 07:57:51.332384 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 54945us
I20260503 07:57:51.337220 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:51.337745 28103 raft_consensus.cc:606] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:51.343747 27924 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:51.349625 27954 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.369127 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:51.373888 29487 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.375181 29477 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260503 07:57:51.355598 29500 log.cc:927] Time spent T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.073s user 0.000s sys 0.003s
I20260503 07:57:51.362119 29461 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260503 07:57:51.330111 29353 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.359273 29498 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:57:51.382851 29498 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:51.383733 29498 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.417586 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:51.431136 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:51.435421 27924 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:51.428088 29483 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.448237 29473 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:57:51.465246 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 113711us
I20260503 07:57:51.471179 28028 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:57:51.474177 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:51.486418 29482 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:51.497874 29482 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:51.501783 28102 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:51.502744 29483 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.510040 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:51.500979 29482 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:51.512949 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.515349 29485 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:51.515508 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:51.517596 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:51.527122 27999 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:51.528394 27958 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:51.525229 29466 consensus_queue.cc:1059] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:51.534233 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:51.547163 29353 raft_consensus.cc:3055] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:57:51.547462 29453 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:57:51.536831 28103 raft_consensus.cc:606] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:51.547556 29353 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:51.550141 29353 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.551340 29353 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:51.553419 27956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:57:51.554064 27956 raft_consensus.cc:606] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:51.564787 28614 raft_consensus.cc:2955] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.573385 27854 catalog_manager.cc:5671] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:51.576550 29483 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260503 07:57:51.582455 28106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:51.583367 28106 raft_consensus.cc:606] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:51.586052 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:57:51.587706 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:51.588481 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:51.628258 29515 raft_consensus.cc:993] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.628785 29514 raft_consensus.cc:1081] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.629118 29461 raft_consensus.cc:993] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.629676 29461 raft_consensus.cc:1081] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.650995 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:51.651654 29453 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:57:51.652194 29498 raft_consensus.cc:993] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.652609 29498 raft_consensus.cc:1081] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.680244 29487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43212 (request call id 418) took 1569 ms. Trace:
I20260503 07:57:51.681417 29240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43212 (request call id 417) took 1572 ms. Trace:
I20260503 07:57:51.680694 29487 rpcz_store.cc:276] 0503 07:57:50.110376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:50.110912 (+ 536us) service_pool.cc:224] Handling call
0503 07:57:50.124167 (+ 13255us) log.cc:844] Serialized 487 byte log entry
0503 07:57:50.263979 (+139812us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18002ce900. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501654be6 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85046a4f06 00007f850469e87a 00007f850469daf4
0503 07:57:50.275869 (+ 11890us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b5400311120. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850469d522 00007f850467e28a 00007f8504685133 00007f85046850b9 00007f8504685049 00007f8504685011 00007f85046841dd 0000000000379254 0000000000379099 00007f8501686ab5
0503 07:57:51.680170 (+1404301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6812,"raft.run_cpu_time_us":4085,"raft.run_wall_time_us":105461,"spinlock_wait_cycles":19691520,"thread_start_us":86090,"threads_started":1,"wal-append.queue_time_us":124827,"wal-append.run_cpu_time_us":2623,"wal-append.run_wall_time_us":1090710}
I20260503 07:57:51.682888 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet d4a767f631d84b75af79d3964f3a548f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:51.681878 29240 rpcz_store.cc:276] 0503 07:57:50.109149 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:50.109272 (+ 123us) service_pool.cc:224] Handling call
0503 07:57:50.113455 (+ 4183us) log.cc:844] Serialized 487 byte log entry
0503 07:57:51.681355 (+1567900us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1621,"raft.queue_time_us":33188,"raft.run_cpu_time_us":920,"raft.run_wall_time_us":918,"thread_start_us":323661,"threads_started":3,"wal-append.queue_time_us":123668,"wal-append.run_cpu_time_us":1732,"wal-append.run_wall_time_us":1035742}
I20260503 07:57:51.684737 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:51.690297 27857 catalog_manager.cc:5671] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.691965 27857 catalog_manager.cc:5671] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.705502 27855 catalog_manager.cc:5671] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:51.713234 28035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:57:51.713735 28035 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:51.714102 28035 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.720281 28035 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.724640 28035 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.735306 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:57:51.735795 28031 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:51.736135 28031 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:51.737329 28028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:57:51.737846 28028 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:51.738184 28028 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:51.743975 28614 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:51.748215 28028 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.749069 28035 raft_consensus.cc:1240] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4. Ops: []
I20260503 07:57:51.753441 28028 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.757907 28031 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.760236 28031 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.761801 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.762319 28103 raft_consensus.cc:3055] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:57:51.762684 28103 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:51.766079 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.766606 28106 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:51.769284 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:51.769397 28103 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.770112 27952 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.770524 28103 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.776525 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:51.777048 27956 raft_consensus.cc:3055] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:51.777305 27956 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:51.778000 29353 consensus_queue.cc:1059] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:51.778852 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:51.777902 27956 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.779964 27956 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:51.779182 29353 raft_consensus.cc:3055] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:51.782189 29353 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:51.782948 29353 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.784161 29353 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:51.788664 28106 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:51.793944 27956 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:51.794932 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:51.795645 29453 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:51.796103 29453 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:51.796906 29453 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.805624 27958 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:51.807358 27952 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:57:51.808655 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:51.809377 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.809930 28101 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:51.810603 29482 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:57:51.811070 29482 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:51.811209 28103 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:57:51.811890 29482 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.813000 27999 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:51.815585 29196 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:51.816073 29196 raft_consensus.cc:697] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:51.816823 29196 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.768301 27855 catalog_manager.cc:5671] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:57:51.825560 27943 tablet_service.cc:1558] Processing DeleteTablet for tablet c9d2b513dd664ccfbfcbd9f74fe0dddf with delete_type TABLET_DATA_TOMBSTONED (TS 37e72845941344c9b0aaa7235a6f4473 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45162
I20260503 07:57:51.827384 28021 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a767f631d84b75af79d3964f3a548f with delete_type TABLET_DATA_TOMBSTONED (TS adaf84b6ac60420ab03d39b9db9f0413 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33286
I20260503 07:57:51.836443 28101 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:51.843083 29518 raft_consensus.cc:993] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.843753 28031 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:57:51.845197 29518 raft_consensus.cc:1081] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.849887 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:57:51.850342 28031 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:51.850641 28031 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:51.856259 29486 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:57:51.860188 27854 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:51.864498 28031 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.868165 27952 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:57:51.873088 29486 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260503 07:57:51.874714 29530 tablet_replica.cc:333] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: stopping tablet replica
I20260503 07:57:51.878907 29530 raft_consensus.cc:2243] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:51.879822 29530 raft_consensus.cc:2272] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:51.886649 28031 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.887130 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:51.887614 27958 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:51.882884 29530 ts_tablet_manager.cc:1916] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:51.890563 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.893658 28101 raft_consensus.cc:3055] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:51.893936 28101 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:51.894948 27958 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:51.894587 28101 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.896411 28101 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:51.896346 27999 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:51.901865 29453 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:51.902087 29240 raft_consensus.cc:993] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.902359 29453 raft_consensus.cc:697] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:51.902530 29240 raft_consensus.cc:1081] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:51.903182 29453 consensus_queue.cc:237] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.905879 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:57:51.906363 28031 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:51.906597 28028 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.906688 28031 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.907821 29463 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:51.908370 29463 consensus_queue.cc:1243] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer adaf84b6ac60420ab03d39b9db9f0413 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260503 07:57:51.910509 28028 pending_rounds.cc:85] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 1
I20260503 07:57:51.910754 28028 pending_rounds.cc:107] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260503 07:57:51.910949 28028 raft_consensus.cc:2889] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:57:51.911973 29528 tablet_replica.cc:333] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: stopping tablet replica
I20260503 07:57:51.913098 28031 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.917683 28101 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:51.926400 29528 raft_consensus.cc:2243] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:51.927155 29528 raft_consensus.cc:2272] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:51.932801 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:51.934448 27958 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:51.943778 27958 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:57:51.944790 29209 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.946039 28028 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:51.960358 28031 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:51.961899 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:51.962610 28106 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:57:51.962942 28106 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:51.963748 28106 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:51.967221 29528 ts_tablet_manager.cc:1916] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:51.970367 28031 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:57:51.973906 29353 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:51.989604 28101 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:57:51.997540 28106 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:57:52.010484 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:52.013851 28106 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:57:52.004596 29508 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260503 07:57:52.030614 27956 raft_consensus.cc:2955] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:52.017305 29482 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:57:52.046479 29482 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:52.046808 29530 ts_tablet_manager.cc:1929] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260503 07:57:52.047220 29530 log.cc:1199] T d4a767f631d84b75af79d3964f3a548f P adaf84b6ac60420ab03d39b9db9f0413: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/wals/d4a767f631d84b75af79d3964f3a548f
I20260503 07:57:52.047345 29482 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:52.049237 29528 ts_tablet_manager.cc:1929] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:57:52.049645 29528 log.cc:1199] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 37e72845941344c9b0aaa7235a6f4473: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/wals/c9d2b513dd664ccfbfcbd9f74fe0dddf
I20260503 07:57:52.053659 27844 catalog_manager.cc:5002] TS adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): tablet d4a767f631d84b75af79d3964f3a548f (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:52.055069 27854 catalog_manager.cc:5671] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:52.060968 27854 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 2 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:52.062934 27854 catalog_manager.cc:5671] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:52.064534 27854 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:52.079236 28101 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:57:52.088554 27856 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:52.093003 27842 catalog_manager.cc:5002] TS 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): tablet c9d2b513dd664ccfbfcbd9f74fe0dddf (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:52.100559 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:57:52.102036 29498 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260503 07:57:52.118840 28098 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 with delete_type TABLET_DATA_TOMBSTONED (TS be26cebb7c90445ea9a74f66463457c1 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43212
I20260503 07:57:52.155431 29539 tablet_replica.cc:333] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: stopping tablet replica
I20260503 07:57:52.169893 29539 raft_consensus.cc:2243] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260503 07:57:52.170634 29539 raft_consensus.cc:2272] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260503 07:57:52.176862 27854 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:52.187598 29539 ts_tablet_manager.cc:1916] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:57:52.212455 29539 ts_tablet_manager.cc:1929] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260503 07:57:52.212596 28103 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:52.212847 29539 log.cc:1199] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P be26cebb7c90445ea9a74f66463457c1: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/wals/3d2e3ed8ebbe4d968d5ab9e678ea1561
I20260503 07:57:52.213953 29453 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:52.224447 27842 catalog_manager.cc:5002] TS be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): tablet 3d2e3ed8ebbe4d968d5ab9e678ea1561 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:57:52.237386 27952 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:52.239580 29485 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:52.261137 28103 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:57:52.262307 29485 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:52.280625 27952 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:57:52.285174 29453 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:52.312894 27958 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:52.314180 29485 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:52.340535 28103 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:52.342285 29196 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:52.419265 28101 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:52.420743 29453 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:52.434234 27958 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:52.435770 29482 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:52.623347 27952 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:57:52.624879 29482 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:52.647313 29464 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:52.647905 29464 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:52.651957 29464 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:52.657326 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:52.657964 27952 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:57:52.661630 28103 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:57:52.663056 28073 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:52.664633 29518 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:52.664976 29518 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:52.666138 29518 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:52.669061 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:52.669802 28030 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:52.700418 29518 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:52.709525 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:52.720809 29482 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260503 07:57:52.729949 29518 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:52.735322 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:52.736034 28030 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:57:52.759178 27952 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:57:52.760565 28073 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:52.761313 29464 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:57:52.761794 29464 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:52.762584 29464 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:52.793435 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:52.813323 27857 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:57:52.972702 28030 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:52.992622 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:52.993175 28103 raft_consensus.cc:606] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:52.999486 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:53.000016 28103 raft_consensus.cc:606] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:53.002499 27954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:57:53.003024 27954 raft_consensus.cc:606] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:53.009574 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77488bc798a841d697b108fb23d5531b"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:53.010115 28103 raft_consensus.cc:606] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:53.014593 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:53.015091 28103 raft_consensus.cc:606] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:53.018519 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:57:53.020126 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:53.020810 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:53.023571 28103 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:53.023965 27954 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260503 07:57:53.027549 27999 consensus_peers.cc:597] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9376e27fcb734be296a0612be76962b1. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:53.029170 29483 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:53.031069 29482 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:53.065161 29554 raft_consensus.cc:993] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:53.065665 29454 raft_consensus.cc:1081] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:53.067234 27958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45178
I20260503 07:57:53.067747 27958 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:53.068105 27958 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:53.074887 27958 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.079058 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:53.079632 28106 raft_consensus.cc:3055] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:53.079933 28106 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:53.080668 28106 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.082334 28106 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:53.084496 27958 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:53.099568 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:53.100117 28031 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:53.110224 28031 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:53.114312 27926 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:53.115087 29498 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:53.115581 29498 raft_consensus.cc:697] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:53.116480 29498 consensus_queue.cc:237] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.120728 28106 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:53.140450 27857 catalog_manager.cc:5671] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.170913 29483 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.172188 27954 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.188071 27952 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:53.174685 28103 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.194844 27857 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.210305 29548 raft_consensus.cc:993] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:53.210747 29548 raft_consensus.cc:1081] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:53.216199 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:57:53.217659 28031 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:53.218019 28031 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:53.234952 28106 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260503 07:57:53.236316 29461 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260503 07:57:53.241369 27924 consensus_peers.cc:597] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 816629c788364a77be087fd62784f4de. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:53.241508 28030 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260503 07:57:53.246089 29498 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:53.280421 27958 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:57:53.282130 29554 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:53.287060 28031 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:53.289683 29559 log.cc:927] Time spent T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260503 07:57:53.291190 28030 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:57:53.291289 28031 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:53.292812 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:53.292951 29548 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:53.293381 28101 raft_consensus.cc:3055] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:53.293730 28101 raft_consensus.cc:740] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:53.292501 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:53.294760 27954 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:53.294411 28101 consensus_queue.cc:260] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.296679 28101 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:53.305784 29461 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.309540 28101 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:53.310412 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:53.311167 29453 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:53.311616 29453 raft_consensus.cc:697] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:53.312390 29453 consensus_queue.cc:237] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.327320 27954 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:53.333133 28030 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:53.332823 28035 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.349707 28106 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.362686 27855 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.383870 27952 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260503 07:57:53.384284 27999 consensus_peers.cc:597] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bd4f1f94ce446d19045339767e2f84a. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:53.383899 28106 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260503 07:57:53.385252 29196 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260503 07:57:53.393399 29483 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:53.428894 29554 raft_consensus.cc:993] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:53.429435 29554 raft_consensus.cc:1081] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:53.430871 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:57:53.431398 28031 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:53.431834 28031 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:53.440567 29196 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.443146 29554 raft_consensus.cc:993] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:53.443616 29548 raft_consensus.cc:1081] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:53.445091 27954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77488bc798a841d697b108fb23d5531b"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45178
I20260503 07:57:53.445545 27954 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:53.445838 27954 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:53.432955 27857 catalog_manager.cc:5671] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.450057 28101 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.453271 27954 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.457880 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:53.458353 28035 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:53.459331 27954 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:53.464905 28106 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:53.462466 28031 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:53.468290 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:53.468847 28102 raft_consensus.cc:3055] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:53.469142 28102 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:53.469664 28035 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:53.469795 28102 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.470484 28031 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:53.470922 28102 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:53.471098 27926 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:53.472383 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:53.472941 28103 raft_consensus.cc:3055] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:57:53.473311 28103 raft_consensus.cc:740] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:53.473874 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:57:53.474440 28614 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:53.474040 28103 consensus_queue.cc:260] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:53.475320 28103 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:57:53.477216 29461 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:53.477739 29461 raft_consensus.cc:697] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:53.478660 29461 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.490355 28614 raft_consensus.cc:2468] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:53.492606 28103 raft_consensus.cc:2468] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:53.492982 28102 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
W20260503 07:57:53.495711 28073 consensus_peers.cc:597] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 971ac26c5f9841959a1801eb548b0ff0. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:57:53.495977 29498 raft_consensus.cc:993] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:53.505712 29498 raft_consensus.cc:1081] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:53.496804 27958 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:53.499287 28035 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:57:53.501890 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:53.508632 29453 raft_consensus.cc:2804] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:57:53.509099 29453 raft_consensus.cc:697] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:53.509902 29453 consensus_queue.cc:237] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:53.513525 29554 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:53.515614 29554 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:53.515870 27856 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.555262 27952 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.531994 27854 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.522149 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:57:53.561443 28031 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:53.561792 28031 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:53.567973 28031 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.567730 29454 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.569741 28031 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:53.574790 27856 catalog_manager.cc:5671] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.577512 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:53.578034 27956 raft_consensus.cc:3055] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:57:53.578315 27956 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:53.578943 27956 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.579988 27956 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:53.584092 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:53.584656 28102 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:53.599691 28027 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:53.600953 29498 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:53.605093 27956 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:53.609256 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:53.610294 29483 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:53.610798 29483 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:53.611646 29483 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:53.617295 28103 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:53.606703 28031 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
W20260503 07:57:53.624390 29576 log.cc:927] Time spent T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20260503 07:57:53.625712 29578 ts_tablet_manager.cc:933] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:53.630304 28102 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:53.634706 27958 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:57:53.636703 29498 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:53.624018 27857 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.676074 29581 ts_tablet_manager.cc:933] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:53.721105 29578 tablet_copy_client.cc:323] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.2:41375
I20260503 07:57:53.725162 28044 tablet_copy_service.cc:140] P adaf84b6ac60420ab03d39b9db9f0413: Received BeginTabletCopySession request for tablet 9376e27fcb734be296a0612be76962b1 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:43620)
I20260503 07:57:53.725853 28044 tablet_copy_service.cc:161] P adaf84b6ac60420ab03d39b9db9f0413: Beginning new tablet copy session on tablet 9376e27fcb734be296a0612be76962b1 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:43620: session id = 25017111886b42cfa5701a39de59b6ad-9376e27fcb734be296a0612be76962b1
I20260503 07:57:53.729700 29581 tablet_copy_client.cc:323] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.1:34525
I20260503 07:57:53.731410 27970 tablet_copy_service.cc:140] P 37e72845941344c9b0aaa7235a6f4473: Received BeginTabletCopySession request for tablet 816629c788364a77be087fd62784f4de from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:41856)
I20260503 07:57:53.731986 27970 tablet_copy_service.cc:161] P 37e72845941344c9b0aaa7235a6f4473: Beginning new tablet copy session on tablet 816629c788364a77be087fd62784f4de from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:41856: session id = 25017111886b42cfa5701a39de59b6ad-816629c788364a77be087fd62784f4de
I20260503 07:57:53.749496 28044 tablet_copy_source_session.cc:215] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:53.751255 27854 catalog_manager.cc:5671] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 2 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:53.751629 27970 tablet_copy_source_session.cc:215] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:53.756753 29578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9376e27fcb734be296a0612be76962b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:53.767150 29581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816629c788364a77be087fd62784f4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:53.789285 29581 tablet_copy_client.cc:806] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:53.789984 29581 tablet_copy_client.cc:670] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:53.811518 29578 tablet_copy_client.cc:806] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:53.812095 29578 tablet_copy_client.cc:670] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:53.820325 29578 tablet_copy_client.cc:538] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:53.829595 29578 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:53.862533 29581 tablet_copy_client.cc:538] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:53.873126 28103 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:53.874429 29582 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:53.879238 28102 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:53.901798 29196 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:53.922468 29581 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:53.934979 27958 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:57:53.940191 29578 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:53.941179 29578 tablet_bootstrap.cc:492] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:53.941848 29578 ts_tablet_manager.cc:1403] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.112s user 0.039s sys 0.012s
I20260503 07:57:53.946425 29453 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:57:53.944834 29578 raft_consensus.cc:359] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:53.949550 29578 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:53.957510 29589 ts_tablet_manager.cc:933] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:53.964743 29578 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:53.974128 29578 ts_tablet_manager.cc:1434] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.032s user 0.004s sys 0.003s
I20260503 07:57:53.981467 28044 tablet_copy_service.cc:342] P adaf84b6ac60420ab03d39b9db9f0413: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-9376e27fcb734be296a0612be76962b1 received from {username='slave'} at 127.0.0.1:43620
I20260503 07:57:53.981923 28044 tablet_copy_service.cc:434] P adaf84b6ac60420ab03d39b9db9f0413: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-9376e27fcb734be296a0612be76962b1 on tablet 9376e27fcb734be296a0612be76962b1 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:53.989058 29589 tablet_copy_client.cc:323] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.2:41375
I20260503 07:57:53.996025 28044 tablet_copy_service.cc:140] P adaf84b6ac60420ab03d39b9db9f0413: Received BeginTabletCopySession request for tablet 7bd4f1f94ce446d19045339767e2f84a from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:43620)
I20260503 07:57:53.996503 28044 tablet_copy_service.cc:161] P adaf84b6ac60420ab03d39b9db9f0413: Beginning new tablet copy session on tablet 7bd4f1f94ce446d19045339767e2f84a from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:43620: session id = 25017111886b42cfa5701a39de59b6ad-7bd4f1f94ce446d19045339767e2f84a
I20260503 07:57:54.004850 28044 tablet_copy_source_session.cc:215] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:54.008247 29578 ts_tablet_manager.cc:933] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:54.010231 28614 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:54.012729 29581 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:54.013620 29581 tablet_bootstrap.cc:492] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:54.013782 28031 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:57:54.014048 29589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd4f1f94ce446d19045339767e2f84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:54.014483 29581 ts_tablet_manager.cc:1403] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.095s user 0.030s sys 0.007s
I20260503 07:57:54.020008 29581 raft_consensus.cc:359] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:54.020828 29581 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:54.021626 29581 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:54.024124 28102 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:57:54.030443 29578 tablet_copy_client.cc:323] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:57:54.024201 29581 ts_tablet_manager.cc:1434] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260503 07:57:54.036707 28118 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet 971ac26c5f9841959a1801eb548b0ff0 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:57:54.037276 28118 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet 971ac26c5f9841959a1801eb548b0ff0 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-971ac26c5f9841959a1801eb548b0ff0
I20260503 07:57:54.037953 27970 tablet_copy_service.cc:342] P 37e72845941344c9b0aaa7235a6f4473: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-816629c788364a77be087fd62784f4de received from {username='slave'} at 127.0.0.1:41856
I20260503 07:57:54.038455 27970 tablet_copy_service.cc:434] P 37e72845941344c9b0aaa7235a6f4473: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-816629c788364a77be087fd62784f4de on tablet 816629c788364a77be087fd62784f4de with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:54.041855 29582 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:54.043605 29483 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:54.044234 29196 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:57:54.075896 27952 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:54.091521 29453 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:54.093801 28118 tablet_copy_source_session.cc:215] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:57:54.097289 29578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 971ac26c5f9841959a1801eb548b0ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:57:54.116343 29578 tablet_copy_client.cc:806] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:54.116861 29578 tablet_copy_client.cc:670] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:54.121073 29578 tablet_copy_client.cc:538] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:54.131964 28619 raft_consensus.cc:1217] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20260503 07:57:54.139899 29578 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
W20260503 07:57:54.148656 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 105625us
I20260503 07:57:54.164275 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:54.172721 29589 tablet_copy_client.cc:806] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:57:54.173363 28102 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:57:54.179102 29589 tablet_copy_client.cc:670] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:57:54.199635 29196 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:54.203305 29589 tablet_copy_client.cc:538] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:57:54.236532 29589 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:57:54.258061 29578 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:54.286206 29578 tablet_bootstrap.cc:492] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
W20260503 07:57:54.281317 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 59549.2us
I20260503 07:57:54.298889 29578 ts_tablet_manager.cc:1403] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.159s user 0.021s sys 0.003s
I20260503 07:57:54.323727 28614 raft_consensus.cc:1217] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260503 07:57:54.331959 29578 raft_consensus.cc:359] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:54.333822 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:54.334342 28103 raft_consensus.cc:606] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:54.332787 29578 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:54.345525 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:54.345994 28102 raft_consensus.cc:606] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:54.348786 28035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:54.349262 28035 raft_consensus.cc:606] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:54.353535 29578 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:54.355458 28103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:57:54.355971 28103 raft_consensus.cc:606] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:54.357110 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260503 07:57:54.358656 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:54.359321 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:57:54.360762 29578 ts_tablet_manager.cc:1434] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.055s user 0.005s sys 0.001s
I20260503 07:57:54.376247 28118 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-971ac26c5f9841959a1801eb548b0ff0 received from {username='slave'} at 127.0.0.1:59398
I20260503 07:57:54.376652 28118 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-971ac26c5f9841959a1801eb548b0ff0 on tablet 971ac26c5f9841959a1801eb548b0ff0 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:54.407105 29589 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:57:54.407923 29589 tablet_bootstrap.cc:492] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:57:54.408541 29589 ts_tablet_manager.cc:1403] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.172s user 0.013s sys 0.012s
I20260503 07:57:54.411433 29589 raft_consensus.cc:359] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:54.412184 29589 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:57:54.412803 29589 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:54.420691 29589 ts_tablet_manager.cc:1434] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260503 07:57:54.422047 29594 raft_consensus.cc:993] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:54.422492 29594 raft_consensus.cc:1081] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:54.425477 28044 tablet_copy_service.cc:342] P adaf84b6ac60420ab03d39b9db9f0413: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-7bd4f1f94ce446d19045339767e2f84a received from {username='slave'} at 127.0.0.1:43620
I20260503 07:57:54.425858 28044 tablet_copy_service.cc:434] P adaf84b6ac60420ab03d39b9db9f0413: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-7bd4f1f94ce446d19045339767e2f84a on tablet 7bd4f1f94ce446d19045339767e2f84a with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:57:54.427654 27958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45178
I20260503 07:57:54.428187 27958 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:54.428494 27958 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.438308 28614 raft_consensus.cc:1217] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:57:54.450881 27958 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.453486 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:54.453962 28102 raft_consensus.cc:3055] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:54.454222 28102 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:54.454903 28102 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.455849 28102 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.457707 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:54.458204 28031 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.476483 28031 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:54.477242 27958 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:54.477566 27926 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:54.478184 28102 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:54.478361 29461 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:54.478946 29461 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:54.479741 29461 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.514345 27857 catalog_manager.cc:5671] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:54.532054 29554 raft_consensus.cc:993] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:54.532444 29554 raft_consensus.cc:1081] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:54.534130 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:57:54.534646 28031 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:54.534988 28031 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.546329 28031 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.549089 28031 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:54.551642 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:54.552227 28103 raft_consensus.cc:3055] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:54.552543 28103 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:54.553336 28103 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.554312 28103 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.557971 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:54.558631 27952 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.590946 29454 raft_consensus.cc:993] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:54.591629 29454 raft_consensus.cc:1081] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:57:54.610550 28027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:57:54.611037 28027 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:54.611387 28027 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.621615 28027 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.623165 28027 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:54.643980 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:54.644778 27958 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.653365 27952 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:54.639510 28103 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:54.655577 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:54.661446 28102 raft_consensus.cc:3055] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:57:54.661760 28102 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:57:54.662518 28102 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.664603 28102 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:54.669641 28102 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:54.676203 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:54.677114 27958 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:54.678081 29196 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:54.678689 29196 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:54.679448 29196 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.686185 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:54.687216 29453 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:57:54.687707 29453 raft_consensus.cc:697] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:54.688449 29453 consensus_queue.cc:237] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.732249 29482 raft_consensus.cc:993] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:54.733227 29483 raft_consensus.cc:1081] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:57:54.747047 27857 catalog_manager.cc:5671] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:54.750680 27958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:57:54.751148 27958 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:57:54.751441 27958 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:57:54.761523 27958 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.768836 29482 raft_consensus.cc:1064] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:54.769502 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:57:54.770010 28102 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:57:54.770990 29482 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:54.774101 27857 catalog_manager.cc:5671] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:54.794413 29461 raft_consensus.cc:1064] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:54.796741 29461 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:54.781922 28102 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:57:54.803922 27924 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:54.804723 29566 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:57:54.805922 29566 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:57:54.806767 29566 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.783772 27958 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:54.818593 28103 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260503 07:57:54.820325 28614 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260503 07:57:54.823513 28619 raft_consensus.cc:1217] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260503 07:57:54.824414 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:54.824918 28031 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:57:54.825215 28031 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:57:54.825832 28031 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:54.826853 28031 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:57:54.832024 27958 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260503 07:57:54.841863 28031 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:57:54.846828 29612 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:54.850878 27857 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:57:54.859503 28103 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260503 07:57:54.860860 28614 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260503 07:57:54.862874 29582 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:54.866720 29498 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:54.867370 29453 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:54.869181 29196 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:54.901319 28027 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260503 07:57:54.979952 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 73414.1us
W20260503 07:57:55.503952 28583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s user 0.008s sys 0.009s
W20260503 07:57:55.504412 28583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s user 0.008s sys 0.009s
W20260503 07:57:55.548393 28075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s user 0.004s sys 0.025s
W20260503 07:57:55.550066 28075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s user 0.004s sys 0.025s
W20260503 07:57:55.716141 28072 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s user 0.007s sys 0.010s
W20260503 07:57:55.716673 28072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s user 0.008s sys 0.010s
I20260503 07:57:55.718138 29631 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:57:55.731375 27958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s user 0.032s sys 0.011s
W20260503 07:57:55.731875 27958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s user 0.033s sys 0.012s
I20260503 07:57:55.756531 29643 raft_consensus.cc:1064] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:57:55.758896 29643 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.240408 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260503 07:57:56.495811 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:57:56.492820 29643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s user 0.040s sys 0.061s
I20260503 07:57:56.501312 29641 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:57:56.503046 29643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s user 0.040s sys 0.061s
I20260503 07:57:56.512406 29647 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.520331 29647 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.522221 29648 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.522004 29649 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.527544 29650 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.528976 29650 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:56.531358 28585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.155s user 0.015s sys 0.036s
I20260503 07:57:56.531513 29650 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.533109 29649 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.535825 29649 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.536448 29649 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.537101 29649 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.539433 29649 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.521068 29641 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.542515 29641 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.527793 29648 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.546769 29648 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:56.547370 29631 consensus_meta.cc:287] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.824s user 0.009s sys 0.001s
W20260503 07:57:56.531744 28585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.156s user 0.015s sys 0.036s
I20260503 07:57:56.550921 29630 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.548837 29647 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.551375 29630 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.551816 29627 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.552502 29627 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.553388 29630 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.554942 29627 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.562963 29646 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.563452 29646 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.565362 29646 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.564473 29648 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.567960 29648 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.570312 29648 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.577191 29196 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.577795 29196 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.579994 29196 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.580533 29196 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.580987 29196 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.610159 29196 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.616032 29649 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.626395 29649 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.628383 29649 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.616456 29648 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.629366 29648 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.631158 29648 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.631606 29648 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.632045 29648 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.628849 29649 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.633538 29649 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.633934 29657 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.635300 29657 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.636880 29648 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.637964 29657 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.635684 29649 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.652066 29648 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.653839 29651 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.655159 29651 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.657740 29651 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.654520 29657 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.653177 29648 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.665076 29631 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.665571 29631 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.667420 29631 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.667332 29648 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.668318 29656 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:56.669143 29651 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.670192 29651 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.668838 29656 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.664650 29657 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.673300 29651 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.675756 29657 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.680305 29651 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.681591 29651 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.691192 28027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:56.699281 28027 raft_consensus.cc:606] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:56.679244 29648 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.679167 29649 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:56.701874 29649 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.714063 29648 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.680065 29656 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.713763 29651 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.714170 28027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:57:56.715202 28027 raft_consensus.cc:606] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:57:56.715880 29648 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.717856 29649 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.720934 29655 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.679829 29657 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.680318 29631 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.721935 29654 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.724035 29654 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.725193 29658 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.725696 29658 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.727674 29658 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.728165 29658 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.728612 29658 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.721434 29655 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.732620 29658 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.733553 29655 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.733987 29654 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.730257 29657 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.736624 29657 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.730599 29631 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.739240 29631 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.751448 29657 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.773908 29657 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.774581 29648 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.775600 29657 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.776048 29655 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.776698 29655 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.777153 29659 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.777684 29659 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.779031 29655 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.779671 29655 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.780721 29654 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.781383 29654 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.783152 29654 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.779773 29659 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.775229 29648 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:56.789271 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 82528.8us
I20260503 07:57:56.780360 29655 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:56.776085 29657 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.826038 29657 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:56.828029 29657 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.829324 29654 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:57:56.831197 29648 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.833868 29655 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.841553 27954 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:56.847817 27958 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:56.850435 29641 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.851115 29652 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.850953 29641 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:56.851540 29652 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.853149 29643 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.853266 29652 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.853631 29643 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.855422 29643 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.855827 29652 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.852828 29641 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.856312 29652 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.859218 29652 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.861603 29662 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.861725 29624 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.862156 29662 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.862241 29624 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.864058 29662 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.864127 29624 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.865070 29594 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.865659 29624 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:56.865536 29594 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.866171 29624 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.867800 29594 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.867991 29624 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.868345 29594 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.868746 29641 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.869119 29594 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.869246 29641 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.870870 29594 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.871029 29641 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.871313 29594 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:56.872179 29482 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.865504 29662 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.872682 29482 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:56.872773 29662 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.874508 29482 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.871990 29594 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.875099 29482 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:56.875581 29482 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.876133 29594 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.876574 29662 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.877569 29482 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.878517 29639 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.878979 29639 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.880775 29639 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.881836 29482 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:56.882334 29482 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.884058 29482 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.885385 29482 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.885628 29650 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.885722 29631 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:56.885928 29482 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:57:56.886214 29650 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.887936 29482 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.888038 29650 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.889205 29647 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.886272 29631 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.891335 29631 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.889681 29647 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.892926 29647 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.894778 29643 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.895267 29643 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.895588 29656 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.896003 29656 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.896404 29620 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.896894 29620 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.896991 29643 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.897707 29656 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.898663 29620 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.901582 29656 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.901732 29620 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.901979 29656 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.902128 29620 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:56.903640 29656 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.903869 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:56.900147 29647 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.904946 29647 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.906793 29647 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.900246 29594 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.911371 29663 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.911896 29663 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.912287 29651 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:56.912943 29654 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:56.913520 29654 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.900331 29631 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.914628 29631 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.915522 29654 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.912739 29651 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.903649 29620 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:56.900051 29650 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.916487 29650 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.916940 29631 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.907646 29594 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.917729 29651 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.918200 29651 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.918251 29650 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.918519 29594 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.900897 29662 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.918708 29651 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.919487 29662 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.922011 27958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:57:56.900125 29624 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.922505 27958 raft_consensus.cc:606] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:56.922956 29624 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.924045 29654 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:56.924580 29654 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.925936 29624 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.927029 29651 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.927030 29663 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.929406 29654 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:56.955214 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:56.962633 29663 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:56.969729 29663 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.971596 29663 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:56.921348 29662 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.931782 29649 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:56.977290 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.979452 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.979961 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.981339 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.981967 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.980964 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.982982 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.983922 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.984299 29650 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.984512 29594 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.984797 29650 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:57:56.985330 29624 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.985599 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:56.985949 29624 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.984999 29594 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.984649 29641 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:56.984972 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.988294 29624 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.988904 29650 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:57:56.989679 29650 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:56.990150 29650 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:56.992131 29650 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.988952 29624 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:56.993358 29624 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:56.995687 29624 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:56.996239 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.996680 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.997328 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:56.997833 27956 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:56.998395 27953 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:56.988060 29594 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:56.988057 29641 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.003119 29641 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:57.011446 29663 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:57.012036 29663 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.012686 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:57.013540 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:57.013943 29663 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:57.014110 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:57.014693 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:57.015229 29594 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:57.015717 29594 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.017905 29594 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:57.018158 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:57.018427 29594 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:57.018951 29594 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.020045 29662 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:57:57.021337 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:57.021551 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:57.012032 28617 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:57:57.024996 29594 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:57.020581 29662 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.395823 29663 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:57.396555 29663 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.399003 29663 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:57.400012 29482 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:57.400588 29482 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.402710 29482 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:57.403154 29482 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:57.403604 29482 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:57.419407 29482 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:57.463119 29482 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:57.463681 29482 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:58.131394 26797 debug-util.cc:398] Leaking SignalData structure 0x7b080000f100 after lost signal to thread 27924
I20260503 07:57:57.468194 29662 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:59.330310 29662 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.330986 29662 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:57:58.468286 27888 debug-util.cc:398] Leaking SignalData structure 0x7b080003bb60 after lost signal to thread 26795
W20260503 07:57:59.333897 27888 debug-util.cc:398] Leaking SignalData structure 0x7b080003c240 after lost signal to thread 27891
W20260503 07:57:59.334159 27888 debug-util.cc:398] Leaking SignalData structure 0x7b080003a340 after lost signal to thread 27905
W20260503 07:57:59.334508 27888 debug-util.cc:398] Leaking SignalData structure 0x7b080003a400 after lost signal to thread 27911
W20260503 07:57:58.955238 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 2.0257e+06us
I20260503 07:57:59.335515 29662 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:59.276893 28103 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:59.338048 29674 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:59.338394 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.338788 29674 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.339227 28103 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:57:59.340458 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.284929 29639 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.341338 29674 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.341756 29639 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:57:59.291518 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:57:59.300894 28109 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:59.304992 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.313704 29624 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.306932 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:59.315378 27981 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8980 after lost signal to thread 26795
I20260503 07:57:59.308375 28100 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:59.319701 29594 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.316721 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.323207 29672 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.325749 29650 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.332563 29482 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.347129 29624 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.349910 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.345038 29639 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.353902 29482 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.359019 29482 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.354681 28103 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:59.357018 29624 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:59.347244 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.350327 29594 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.363941 28109 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:59.364108 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.365167 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.365497 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.365697 29594 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:59.366607 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:59.348474 27981 debug-util.cc:398] Leaking SignalData structure 0x7b0800082d20 after lost signal to thread 27891
W20260503 07:57:59.369668 27981 debug-util.cc:398] Leaking SignalData structure 0x7b0800085ca0 after lost signal to thread 27984
I20260503 07:57:59.370982 28107 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:59.353591 29650 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.374593 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.375335 29650 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.375715 28107 raft_consensus.cc:2410] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260503 07:57:59.376120 29482 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:59.377326 27981 debug-util.cc:398] Leaking SignalData structure 0x7b080013b120 after lost signal to thread 28059
W20260503 07:57:59.379014 27981 debug-util.cc:398] Leaking SignalData structure 0x7b080026df00 after lost signal to thread 28133
W20260503 07:57:59.379315 27981 debug-util.cc:398] Leaking SignalData structure 0x7b080031eb60 after lost signal to thread 28134
I20260503 07:57:59.379595 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.380415 27957 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:57:59.381143 28104 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:57:59.366710 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.376684 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:59.353318 27924 connection.cc:254] RPC call timeout handler was delayed by -1.1949093519999678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260503 07:57:59.385584 27924 connection.cc:254] RPC call timeout handler was delayed by -1.1256093519999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260503 07:57:59.385977 27924 connection.cc:254] RPC call timeout handler was delayed by -1.0977093520000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260503 07:57:59.387372 27924 connection.cc:254] RPC call timeout handler was delayed by -1.0806093520000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260503 07:57:59.387753 27924 connection.cc:254] RPC call timeout handler was delayed by -1.0653093519999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260503 07:57:59.388120 27924 connection.cc:254] RPC call timeout handler was delayed by -1.0527093519999653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260503 07:57:59.388492 27924 connection.cc:254] RPC call timeout handler was delayed by -1.0509093519999624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260503 07:57:59.388862 27924 connection.cc:254] RPC call timeout handler was delayed by -1.0167093520000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260503 07:57:59.390059 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.390631 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.390769 28109 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
W20260503 07:57:59.392413 27958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45176 (request call id 1028) took 2405 ms (client timeout 2072 ms). Trace:
W20260503 07:57:59.392899 27958 rpcz_store.cc:269] 0503 07:57:56.986889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:59.392064 (+2405175us) service_pool.cc:211] Skipping call since client already timed out
0503 07:57:59.392219 (+ 155us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260503 07:57:59.394505 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.396412 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.407971 29674 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.417737 29668 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.418507 29668 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.421193 29639 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.421978 29639 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.424288 29639 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.431591 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:59.437291 28075 connection.cc:254] RPC call timeout handler was delayed by -1.172276449999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260503 07:57:59.437721 28075 connection.cc:254] RPC call timeout handler was delayed by -1.1227764499999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260503 07:57:59.438024 28075 connection.cc:254] RPC call timeout handler was delayed by -1.093858626000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260503 07:57:59.438294 28075 connection.cc:254] RPC call timeout handler was delayed by -1.0309764499999119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260503 07:57:59.438591 28075 connection.cc:254] RPC call timeout handler was delayed by -1.0219764499998973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260503 07:57:59.391685 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.440330 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.432885 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.475450 28107 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:57:59.476440 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.477566 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.480507 29196 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.485479 29196 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.487934 29196 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.488523 29196 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.489269 29196 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.491398 29196 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:59.587461 27924 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.42.3:45643 timed out after 1.518s (SENT)
I20260503 07:57:59.440694 28109 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:59.588307 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.589838 28107 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
W20260503 07:57:59.589915 27981 debug-util.cc:398] Leaking SignalData structure 0x7b0800284b00 after lost signal to thread 28647
W20260503 07:57:59.590385 27981 debug-util.cc:398] Leaking SignalData structure 0x7b080034e800 after lost signal to thread 29397
W20260503 07:57:59.590688 27981 debug-util.cc:398] Leaking SignalData structure 0x7b0800144c40 after lost signal to thread 29454
I20260503 07:57:59.590598 28107 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
W20260503 07:57:59.591101 27981 debug-util.cc:398] Leaking SignalData structure 0x7b0800146b80 after lost signal to thread 29464
I20260503 07:57:59.591318 28107 raft_consensus.cc:606] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:57:59.588609 29196 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.593873 29639 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.593768 29196 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.594425 29639 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.595373 29196 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.593111 29482 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.596493 28101 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:57:59.596263 29639 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.601761 28107 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:59.596243 29482 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.408636 29674 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.420902 29668 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.618528 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:59.619360 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 231051us
I20260503 07:57:59.619468 27957 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.620855 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.621757 27956 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:59.625648 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.625897 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.624873 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.629838 27955 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:59.629971 29196 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.628681 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.630614 29196 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.631433 27958 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:57:59.621704 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.632318 29196 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.632808 29196 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.633551 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.633589 29196 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.644968 29196 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.636909 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.637843 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.638680 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.639256 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.641227 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.642084 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.642294 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.642938 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.645260 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.636008 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.354276 29672 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.648844 27958 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
W20260503 07:57:59.649292 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 2.62787e+06us
I20260503 07:57:59.649487 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.649724 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.650302 27959 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:59.650504 27958 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:59.651381 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.651675 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.652277 27959 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.657244 27955 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.662314 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.662961 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.652971 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.670022 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.672226 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.662606 27953 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:57:59.672894 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.673144 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.673568 28030 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:57:59.657169 29639 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.674876 29675 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:59.675135 29639 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.675454 29675 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.677644 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.677533 28585 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:59.678148 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.677004 29639 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.656940 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 217) took 3059 ms. Trace:
I20260503 07:57:59.681839 27951 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.661906 29674 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:59.689472 28101 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:57:59.690340 27952 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:59.691629 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.691979 29675 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.692157 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.692495 29675 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:57:59.692905 29675 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:57:59.693357 29675 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:59.693598 29482 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:57:59.695377 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.696022 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.696327 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.696441 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.696979 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.697605 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.698439 28027 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:57:59.698691 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.699069 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.699259 28028 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:57:59.700057 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.700452 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:59.700785 27888 debug-util.cc:398] Leaking SignalData structure 0x7b0800199ae0 after lost signal to thread 27984
I20260503 07:57:59.683779 27960 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:59.701489 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.682232 27854 rpcz_store.cc:276] 0503 07:57:56.597825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:57:56.600099 (+ 2274us) service_pool.cc:224] Handling call
0503 07:57:59.656729 (+3056630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3715,"reported_tablets":3}
I20260503 07:57:59.701889 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.686379 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.704927 29654 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.672017 29668 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:57:59.705726 29654 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.706451 29668 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:57:59.706907 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.707528 28032 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
W20260503 07:57:59.701907 27888 debug-util.cc:398] Leaking SignalData structure 0x7b080025d260 after lost signal to thread 28059
I20260503 07:57:59.708290 29654 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.708529 29668 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:59.708913 27926 connection.cc:254] RPC call timeout handler was delayed by -1.3584118759998773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260503 07:57:59.709340 27926 connection.cc:254] RPC call timeout handler was delayed by -1.289111875999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260503 07:57:59.709374 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.700371 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:59.709892 27926 connection.cc:254] RPC call timeout handler was delayed by -1.2612118759999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260503 07:57:59.710022 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.712695 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:59.709237 27888 debug-util.cc:398] Leaking SignalData structure 0x7b080036d300 after lost signal to thread 28133
W20260503 07:57:59.713109 27926 connection.cc:254] RPC call timeout handler was delayed by -1.2288118759998952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260503 07:57:59.710130 28028 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
W20260503 07:57:59.723208 27926 connection.cc:254] RPC call timeout handler was delayed by -1.2162118759998748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260503 07:57:59.723229 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:59.723742 27926 connection.cc:254] RPC call timeout handler was delayed by -1.1802118759999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260503 07:57:59.724164 27926 connection.cc:254] RPC call timeout handler was delayed by -1.1350426850000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260503 07:57:59.724568 27926 connection.cc:254] RPC call timeout handler was delayed by -1.1208118759999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260503 07:57:59.724949 27926 connection.cc:254] RPC call timeout handler was delayed by -1.1053831169999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260503 07:57:59.725353 27926 connection.cc:254] RPC call timeout handler was delayed by -1.0970391609999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260503 07:57:59.725724 27926 connection.cc:254] RPC call timeout handler was delayed by -1.0808391609999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260503 07:57:59.726130 27926 connection.cc:254] RPC call timeout handler was delayed by -1.0803118759998824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260503 07:57:59.726509 27926 connection.cc:254] RPC call timeout handler was delayed by -1.0673391609999499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260503 07:57:59.726919 27926 connection.cc:254] RPC call timeout handler was delayed by -1.0664391609999484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260503 07:57:59.727285 27926 connection.cc:254] RPC call timeout handler was delayed by -1.0614118759999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260503 07:57:59.727659 27926 connection.cc:254] RPC call timeout handler was delayed by -1.0208097709999038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260503 07:57:59.723066 28035 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:59.728313 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:57:59.729152 27888 debug-util.cc:398] Leaking SignalData structure 0x7b080038ab20 after lost signal to thread 28134
I20260503 07:57:59.731930 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.736166 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:59.736928 28617 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:59.739127 28622 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:59.750965 29679 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:57:59.751853 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 164448us
I20260503 07:57:59.751750 29679 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.758824 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.759850 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.769476 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.770634 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.771304 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.771853 28033 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:59.772535 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.772650 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.773067 28027 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:59.773226 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.773497 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.773974 28026 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:57:59.774101 28033 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:59.771790 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.775007 28030 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:59.775921 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:57:59.769658 27888 debug-util.cc:398] Leaking SignalData structure 0x7b0800277160 after lost signal to thread 28647
W20260503 07:57:59.757553 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 75807.2us
I20260503 07:57:59.775921 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.777441 28105 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:59.782167 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.784044 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.771162 29679 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:57:59.785634 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 178814us
I20260503 07:57:59.785800 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.788100 29670 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.788734 29670 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.790993 29670 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.764699 29675 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.793936 29672 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.780607 29654 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.795817 29654 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.793964 29675 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:57:59.797152 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.798046 29654 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.786405 28102 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:57:59.806279 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.806900 28031 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:59.807793 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:57:59.806962 27857 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:59.808318 28034 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:57:59.809341 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.809921 28032 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:57:59.810732 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.812053 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.812340 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.813522 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.814641 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.815237 28029 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:59.815410 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.816068 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.817111 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.816890 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.819124 28026 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:59.823055 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.823235 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.823576 28031 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:59.824194 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.824301 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.824371 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.825031 28026 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:57:59.827142 28105 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:57:59.817772 28028 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:57:59.835345 28034 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
W20260503 07:57:59.817867 28583 connection.cc:254] RPC call timeout handler was delayed by -1.0192523609999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260503 07:57:59.838078 28583 connection.cc:254] RPC call timeout handler was delayed by -1.0192523609999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260503 07:57:59.842350 28031 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:59.843214 28585 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:59.853191 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.845696 27856 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:57:59.857699 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:57:59.861970 29672 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.862229 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.862287 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.862725 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.862916 27957 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.863101 27959 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:57:59.863361 27956 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.863758 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.863963 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.865378 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.865577 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.867452 27958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:57:59.867933 27958 raft_consensus.cc:606] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:57:59.869573 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:59.862515 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.871953 27951 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.872514 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:57:59.873694 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.862253 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:59.862501 29672 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.875779 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:57:59.875836 29683 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:57:59.888772 29683 raft_consensus.cc:697] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:57:59.890693 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:59.891644 29683 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.893095 29672 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:57:59.893615 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:59.893988 29647 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.894260 28617 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:57:59.894738 29647 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:57:59.898524 29647 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:57:59.902027 28073 connection.cc:254] RPC call timeout handler was delayed by -1.4648162480000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260503 07:57:59.902379 28073 connection.cc:254] RPC call timeout handler was delayed by -1.442316248000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260503 07:57:59.902647 28073 connection.cc:254] RPC call timeout handler was delayed by -1.4153162480000674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
I20260503 07:57:59.902693 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:57:59.902995 28073 connection.cc:254] RPC call timeout handler was delayed by -1.3235162480000326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260503 07:57:59.903314 28073 connection.cc:254] RPC call timeout handler was delayed by -1.3145162480000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260503 07:57:59.903584 28073 connection.cc:254] RPC call timeout handler was delayed by -1.299216248000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260503 07:57:59.903851 28073 connection.cc:254] RPC call timeout handler was delayed by -1.2848162480000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260503 07:57:59.904119 28073 connection.cc:254] RPC call timeout handler was delayed by -1.2848162480000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260503 07:57:59.904382 28073 connection.cc:254] RPC call timeout handler was delayed by -1.2749162480000678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260503 07:57:59.904428 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.892400 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260503 07:57:59.904721 28073 connection.cc:254] RPC call timeout handler was delayed by -1.2074162480000723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260503 07:57:59.907251 28073 connection.cc:254] RPC call timeout handler was delayed by -1.2011162480000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260503 07:57:59.907383 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:57:59.907589 28073 connection.cc:254] RPC call timeout handler was delayed by -1.1354162480000696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260503 07:57:59.907874 28073 connection.cc:254] RPC call timeout handler was delayed by -1.1210162480000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260503 07:57:59.908145 28073 connection.cc:254] RPC call timeout handler was delayed by -1.0661162480000712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260503 07:57:59.908399 28073 connection.cc:254] RPC call timeout handler was delayed by -1.0661162480000712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260503 07:57:59.908656 28073 connection.cc:254] RPC call timeout handler was delayed by -1.0355162480000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260503 07:57:59.909775 27956 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
W20260503 07:57:59.908916 28073 connection.cc:254] RPC call timeout handler was delayed by -1.0121162480000976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260503 07:57:59.926632 29676 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:59.929649 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:57:59.931273 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:57:59.940934 28614 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:57:59.941563 29672 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:59.945724 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:59.946789 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:57:59.956426 29676 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:57:59.957930 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.959475 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.963877 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.965054 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.965493 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:57:59.966295 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:57:59.971989 29652 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:57:59.975262 28073 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:57:59.981299 29672 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:57:59.981681 29672 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:57:59.982079 29672 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:57:59.983155 29668 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:57:59.983556 29668 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:57:59.983937 29668 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:57:59.992722 28073 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.001385 29672 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.003888 29652 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:00.004281 29652 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.004649 29652 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:00.008014 29668 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:00.012082 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.013873 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.016235 28073 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.018414 29672 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.017913 29647 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.030756 29647 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.022295 29685 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260503 07:58:00.031226 29647 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.019470 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:00.032640 29676 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.012356 29652 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.033056 29676 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:00.033502 29676 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.034725 29652 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.035498 29670 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:00.036806 27999 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.039721 29647 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.041194 29482 raft_consensus.cc:2749] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.022054 28073 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.041194 29676 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.044423 29652 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:00.044798 29652 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.043066 27999 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.045197 29652 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:00.046103 29482 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.048328 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.048740 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.052175 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.053138 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.053422 28035 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:58:00.020385 29668 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:00.053964 29676 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.053325 28073 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.054214 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.055244 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.055315 29672 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.062305 29647 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.063315 29652 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:00.064293 27924 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.065505 29662 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:00.061409 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.068617 28073 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.070013 29685 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.070441 29685 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:00.070807 29685 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.072978 28073 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.077518 27924 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.077899 29662 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:00.078356 29662 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.078719 29662 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:00.078912 29654 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.080231 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.065506 29652 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.080439 29654 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:00.081799 29647 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.082052 29654 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.082228 29647 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.082643 29647 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.085268 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.090111 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.090638 28035 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:00.091480 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.092571 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.093289 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.093526 28073 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.094514 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.095089 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.095366 29672 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:00.095837 29672 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.096226 29672 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:00.103993 29647 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.107080 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.109243 29654 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.110248 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.113889 28073 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.116523 29652 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.116964 29652 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.117424 29652 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.118096 28027 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:00.118395 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.112663 29673 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.112721 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.118485 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.110157 29685 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.121707 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.122301 29654 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.122937 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.124691 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.124756 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.125116 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.125376 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.126132 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.126375 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.126902 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.127058 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.123189 29672 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.145921 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.146173 29647 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.146358 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.146926 28028 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:00.147147 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.147553 29672 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.147675 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.148258 28028 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:00.148437 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.149315 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.149433 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.134168 29662 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.135324 28073 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.145727 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.145866 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.149019 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.152976 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.152989 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.162163 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.165063 29672 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.165515 29672 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.165876 29672 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.166810 28073 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.167743 29647 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:00.167881 28073 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.168115 29647 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.171327 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:00.170502 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 91528.3us
I20260503 07:58:00.171680 29673 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.172071 29673 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.172402 29673 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.173094 29670 consensus_queue.cc:1059] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:00.173786 29670 consensus_queue.cc:1243] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer 25017111886b42cfa5701a39de59b6ad log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260503 07:58:00.174224 29670 raft_consensus.cc:3055] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:00.174528 29670 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:00.177652 29670 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:00.168509 29647 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:00.174757 29662 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.168673 29652 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.185513 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.187124 28073 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.188100 29662 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.188474 29662 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.188913 29662 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.189347 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.191442 29685 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.196159 29673 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.196954 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.199437 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.199761 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.201345 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.202006 29672 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.202427 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.200785 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.203828 29672 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.204836 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.204535 27854 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 2 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 3 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:00.204856 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.206367 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.205354 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.204555 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.185098 29670 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:00.210868 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.210875 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.213829 29647 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.220261 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.220978 27952 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:00.221735 28073 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.209945 29673 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.223305 29697 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.223706 29697 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:58:00.223882 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:00.224049 29697 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.227440 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:00.228860 27923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:00.229899 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.233250 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.231477 29647 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.233804 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.224602 29662 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.235024 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.241941 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.245666 29662 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.245499 29652 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.247591 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.247840 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.248540 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.249203 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.249625 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.242046 28033 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:00.248921 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.260846 29674 consensus_queue.cc:1059] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:00.261106 29697 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.261894 29680 raft_consensus.cc:3055] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:00.262007 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.262292 29680 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:00.263103 29697 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.263173 29680 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:00.264577 29680 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.274672 28622 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:58:00.276796 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.279788 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.281600 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.282538 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.284523 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.288162 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.291126 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.293802 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.296526 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:00.297088 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 74158.4us
I20260503 07:58:00.298178 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.298346 28073 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.300995 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.300498 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:00.302726 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.303148 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.303400 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.304329 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.305220 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.306001 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.306887 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.308507 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.308450 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.309302 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.310714 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.311272 27957 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:00.307554 29673 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.312568 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.313581 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.312008 29673 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.314612 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.314123 29673 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.315826 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.316602 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.303979 29670 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260503 07:58:00.317775 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.330250 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.319797 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:00.321374 29652 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:00.320972 28614 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:00.322361 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.323185 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.323778 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.324311 29662 raft_consensus.cc:993] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:00.339452 27955 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:58:00.339619 29662 raft_consensus.cc:1081] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:00.340324 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.341327 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.324421 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.324795 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:00.325454 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.325687 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.326453 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.329334 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.344527 27960 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:00.344856 27958 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:00.345947 27953 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:00.345490 27956 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:00.347162 27959 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:00.350075 29662 consensus_queue.cc:1059] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:00.351486 28617 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:00.352391 29652 raft_consensus.cc:3055] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:00.352569 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.317001 28073 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.342662 27951 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:58:00.352779 29652 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:00.353830 29672 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.354194 29672 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.354545 29672 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.356215 29652 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.317894 29699 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.360212 29699 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:00.360543 29699 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.360639 29652 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:00.361184 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 46646.3us
I20260503 07:58:00.360921 29672 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.364699 29672 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.343166 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:00.361244 29670 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:58:00.343006 27999 connection.cc:254] RPC call timeout handler was delayed by -1.9581536219999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260503 07:58:00.369077 27999 connection.cc:254] RPC call timeout handler was delayed by -1.9581536219999407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260503 07:58:00.369388 27999 connection.cc:254] RPC call timeout handler was delayed by -1.7448536219999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260503 07:58:00.369645 27999 connection.cc:254] RPC call timeout handler was delayed by -1.7394536219999281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260503 07:58:00.369885 27999 connection.cc:254] RPC call timeout handler was delayed by -1.7124536219999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260503 07:58:00.370141 27999 connection.cc:254] RPC call timeout handler was delayed by -1.6341536219999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260503 07:58:00.370394 27999 connection.cc:254] RPC call timeout handler was delayed by -1.6278536219999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260503 07:58:00.370630 27999 connection.cc:254] RPC call timeout handler was delayed by -1.5837536220000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260503 07:58:00.370860 27999 connection.cc:254] RPC call timeout handler was delayed by -1.5099536220000118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260503 07:58:00.371088 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4631536219999361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260503 07:58:00.371317 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4505536219999158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260503 07:58:00.371559 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4451536220000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260503 07:58:00.371814 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4208536219999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260503 07:58:00.372077 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4010536219999494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260503 07:58:00.372323 27999 connection.cc:254] RPC call timeout handler was delayed by -1.2948536220000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260503 07:58:00.373330 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.373960 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.374687 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.376385 29701 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:00.376754 29701 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:00.377079 29701 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:00.377394 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.379951 27955 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260503 07:58:00.381963 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.386554 29674 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:00.387332 28073 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.389684 28075 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.398864 28033 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260503 07:58:00.401902 29662 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.356963 29673 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:00.399736 29701 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.390750 29647 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.407860 29680 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260503 07:58:00.409698 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.410455 29672 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.410770 28075 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.407698 29647 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:00.411815 29647 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.410789 29672 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:00.420405 29672 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.417928 29697 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.426244 28105 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:00.425457 28614 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:00.430002 29672 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.431718 29672 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.419778 29670 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260503 07:58:00.434921 27857 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New cstate: current_term: 2 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:00.435809 29673 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:00.441533 29647 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.420727 29652 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260503 07:58:00.459314 29704 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
W20260503 07:58:00.465773 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 55059.1us
I20260503 07:58:00.466697 28075 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:00.468364 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 54616.7us
I20260503 07:58:00.481566 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:00.483397 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:00.490056 28075 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.494618 29673 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:00.494695 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:00.499446 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.504576 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.505826 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.506206 28075 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.509433 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.509965 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.510536 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.510974 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.511500 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.512502 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.512997 27957 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:00.509496 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.513567 27953 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.511521 27954 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:00.514588 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.514758 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.516057 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.516898 28105 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:00.517583 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.517768 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.495313 29652 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.518391 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.518749 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.521265 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.522733 27951 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.522792 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.523301 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.525270 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.525983 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.524775 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.526908 27960 raft_consensus.cc:2393] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:00.527485 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.529131 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.522671 29672 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:00.529513 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.545100 27953 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
W20260503 07:58:00.529193 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 68769us
I20260503 07:58:00.529703 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.529793 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.547148 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.524883 28583 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.530304 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.548072 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.549850 27959 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.556931 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.566183 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.581387 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.582767 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.583250 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.584682 29717 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:00.587729 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 62914.3us
I20260503 07:58:00.587889 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.588562 28583 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.588867 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.589591 28583 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.589812 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:00.590543 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.591498 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:00.591588 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:00.592082 28109 raft_consensus.cc:2393] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:00.593017 28109 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:00.593307 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.594024 28109 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260503 07:58:00.595564 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.595610 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.596428 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.598209 28105 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260503 07:58:00.600690 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.602022 29720 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.603433 29719 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260503 07:58:00.603227 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 59550.9us
I20260503 07:58:00.598006 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.604031 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.606554 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.608566 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:00.609692 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 44428.5us
I20260503 07:58:00.546379 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.612978 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.614223 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:00.614488 28075 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.582028 29701 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:00.620849 27923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:00.615007 29672 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:00.626410 29688 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260503 07:58:00.629511 29696 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260503 07:58:00.630748 29696 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:00.631246 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:00.631775 29705 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:00.620393 29647 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.615876 29699 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.637602 29699 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:00.639595 28075 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.641268 29707 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:00.641655 29708 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:00.643260 27951 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:00.645133 28101 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:00.647269 27954 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:58:00.647826 28075 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.653312 27957 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:00.653578 29672 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.663676 28075 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.666337 29672 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.667428 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.673714 27959 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:00.681085 29672 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:00.682896 28075 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.684692 29699 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.685806 28075 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.686522 29699 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.687618 28075 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.688313 29699 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260503 07:58:00.701505 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 82409us
I20260503 07:58:00.702567 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.702653 28075 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.705651 29699 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.705895 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.707896 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.708799 29668 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.708767 29708 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:00.709978 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.710919 29723 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.711194 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.712399 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.712563 29482 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.713783 29482 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:00.714126 29482 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.714532 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.715276 29668 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:00.715807 29668 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:00.716082 29668 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:00.716398 29668 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:00.711318 29723 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:00.717202 29723 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.723034 29668 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.724072 29482 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.725179 27999 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:00.725603 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 163249us
I20260503 07:58:00.725759 29668 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.710376 29724 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:00.731647 28075 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.732417 29708 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.733878 29672 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.730602 29724 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:00.734927 29724 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:00.733590 29699 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:00.742866 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.743541 29654 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:00.746697 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 816629c788364a77be087fd62784f4de with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:58:00.750720 29723 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.752506 29723 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:00.753085 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 132981us
I20260503 07:58:00.753974 28073 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.755532 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.756910 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.761584 28073 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.762375 28073 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.763906 29672 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.760658 29708 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:00.764336 29701 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.764981 29708 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:00.765090 29727 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:00.765502 29708 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:00.766343 28073 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.767383 29727 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.768678 28073 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.769668 29727 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.771067 28073 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.772020 29727 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:58:00.773898 28073 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.774843 29727 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:00.776288 28073 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.777266 29727 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.780133 28073 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.781147 29727 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:00.782085 29727 raft_consensus.cc:697] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:00.783267 29727 consensus_queue.cc:237] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.785940 29668 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:00.786253 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.786360 29668 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:00.786850 29668 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:00.787874 29676 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:00.788254 29676 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:00.788607 29676 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.788667 28073 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.789937 29701 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.794265 28073 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.795214 29701 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:00.795828 29701 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:00.795704 29676 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:00.797058 29701 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.798370 29708 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.800899 29724 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.801532 28073 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.802539 29672 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:58:00.802873 29724 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.803105 29672 raft_consensus.cc:697] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:00.804226 29672 consensus_queue.cc:237] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:00.808666 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 210723us
I20260503 07:58:00.810316 28073 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.807919 29708 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.812053 28073 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.816299 29697 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:00.816838 29697 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:00.817417 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:00.817791 29697 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.819008 29703 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:00.819396 29703 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:00.819743 29703 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:00.821712 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.825387 29674 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:00.825793 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.826669 29674 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:00.826061 29699 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:00.828408 29482 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.829527 29668 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.830217 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.830955 27956 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:00.831277 29668 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.813337 29707 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:00.831938 29707 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:00.832870 29707 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.839536 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.842105 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.844635 29722 consensus_queue.cc:1059] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:00.846472 29722 raft_consensus.cc:3055] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:00.846800 29722 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:00.847553 29722 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.843115 29654 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.848781 29722 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:00.856822 27952 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:00.855050 29668 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:00.864976 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:00.871404 29703 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.862658 29654 consensus_queue.cc:1059] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260503 07:58:00.873798 29668 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:00.875855 29668 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:00.876046 29676 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:00.876237 29668 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:00.874369 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.877828 29482 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:00.873016 29654 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:00.885533 29654 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:00.886305 29654 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:00.887378 29654 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:00.889710 29668 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:00.892184 29668 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:00.895705 29716 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:00.908193 29703 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:00.883554 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:00.912272 28021 tablet_service.cc:1558] Processing DeleteTablet for tablet 816629c788364a77be087fd62784f4de with delete_type TABLET_DATA_TOMBSTONED (TS adaf84b6ac60420ab03d39b9db9f0413 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33286
I20260503 07:58:00.915855 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.917995 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.919052 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.913766 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.920460 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.921411 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.922380 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.923272 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.923367 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.924729 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.924738 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.926077 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.926805 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.928787 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.930369 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.931609 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.932648 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.933291 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.934360 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.929819 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.938552 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.938509 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.919759 29703 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:00.939910 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.941890 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.942550 28075 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:00.940292 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.942625 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:00.943890 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.945298 27952 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:00.943992 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.944500 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.946094 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.946434 27956 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.946859 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.948891 28101 raft_consensus.cc:1240] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.949872 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.942746 28033 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:00.950253 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.951488 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.951957 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.952304 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.952198 27952 raft_consensus.cc:2410] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260503 07:58:00.952862 28102 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:00.953804 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.954540 27955 raft_consensus.cc:2410] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260503 07:58:00.954661 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.954917 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:00.955899 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:00.956380 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:00.956885 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.957428 27959 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.959076 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:00.959537 28108 raft_consensus.cc:1240] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.960908 28029 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.961926 28029 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.963768 28107 raft_consensus.cc:1240] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:00.963857 28035 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:00.964377 28103 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:00.965051 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.965200 28104 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:00.956223 27926 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:00.967487 28104 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:00.967670 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:00.968024 28101 raft_consensus.cc:1240] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.968255 28109 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 8: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:00.968983 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:00.969621 28031 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 1.
I20260503 07:58:00.969616 27855 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:00.971837 28105 raft_consensus.cc:2955] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:00.974136 28034 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:00.973596 28100 raft_consensus.cc:1240] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:00.966650 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:00.960490 29697 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.026666 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.035905 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.041286 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.041512 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.041714 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.041985 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.042371 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.042732 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.042817 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.043386 28035 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:01.043807 28034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:01.044421 28034 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:01.044371 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.044828 28034 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.033607 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:00.945952 29703 raft_consensus.cc:697] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.034283 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:00.975646 28106 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:01.039976 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.051893 28028 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:01.053637 28108 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:01.055114 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.055662 28102 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:01.057349 28027 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260503 07:58:01.057919 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:01.057812 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 101655us
I20260503 07:58:01.058507 27926 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.060281 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.061369 27999 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.069754 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.072526 29723 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.076483 29723 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.076891 29695 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.079633 29735 tablet_replica.cc:333] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: stopping tablet replica
I20260503 07:58:01.073002 29676 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:01.080374 29676 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:01.080708 29676 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.083649 27857 catalog_manager.cc:5671] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:01.077507 27999 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.085529 27857 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:01.086639 27926 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.086972 27857 catalog_manager.cc:5671] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 2, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 2 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:01.088439 29723 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:01.088557 29716 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.089534 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.057595 29722 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.090257 27857 catalog_manager.cc:5671] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:01.094856 28034 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.096241 28032 raft_consensus.cc:1240] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:01.096334 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.097559 29724 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:01.098147 29724 raft_consensus.cc:2764] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260503 07:58:01.098369 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.098914 29695 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.100772 29685 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:01.101969 27926 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.102882 29695 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.103283 27926 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.096256 27857 catalog_manager.cc:5671] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:01.107206 28034 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:01.110167 27926 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.111102 29695 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.111526 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.111665 29695 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.112318 29695 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260503 07:58:01.112950 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:01.112704 27926 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.120451 28614 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:01.122658 27926 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.123034 29685 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.124034 29685 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.124416 27926 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.124977 29722 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:01.126528 27926 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.127154 29722 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:01.128206 27926 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.128410 29676 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.128906 29722 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:01.129446 28028 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:01.130576 27926 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.131314 29722 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.132705 27926 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.134143 29676 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:01.135572 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.138562 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.138581 27926 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.139501 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.140180 29722 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.140727 29668 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.143846 29668 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.122102 29703 consensus_queue.cc:237] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.153942 28029 raft_consensus.cc:1240] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:01.156105 29674 consensus_queue.cc:1059] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:01.157857 29674 raft_consensus.cc:3055] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:01.158306 29674 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:01.158418 29735 raft_consensus.cc:2243] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:58:01.159298 29735 pending_rounds.cc:70] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Trying to abort 1 pending ops.
I20260503 07:58:01.160244 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.160722 27926 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.154376 29740 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.161566 29654 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.162510 29676 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.160008 29735 pending_rounds.cc:77] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Aborting op as it isn't in flight: id { term: 2 index: 4 } timestamp: 7281848626362179584 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "816629c788364a77be087fd62784f4de" old_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } } new_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } } }
I20260503 07:58:01.163350 29735 raft_consensus.cc:2917] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted
I20260503 07:58:01.163779 29735 raft_consensus.cc:2889] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260503 07:58:01.164122 29735 raft_consensus.cc:2272] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:58:01.161369 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.166657 29676 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:01.166854 29735 ts_tablet_manager.cc:1916] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:01.167676 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.161756 29674 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:01.169305 29674 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:01.173228 29676 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:01.174510 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:01.175009 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:01.175199 29676 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:01.175601 29676 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:01.175949 29676 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.183485 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.191416 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.190038 29668 consensus_queue.cc:1059] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260503 07:58:01.192718 29668 raft_consensus.cc:3055] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.182705 29695 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.193050 29668 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
W20260503 07:58:01.193550 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 48782.3us
I20260503 07:58:01.193864 29668 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.194972 29723 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.195155 29708 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:01.195600 29708 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:01.195922 29708 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:01.196228 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.197268 29723 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:01.197659 29723 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:01.198009 29723 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.197134 29482 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.199492 29482 raft_consensus.cc:3055] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.199805 29482 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.200565 29482 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.201543 29482 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:01.206521 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 45848.5us
I20260503 07:58:01.206316 29723 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.206720 27959 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:01.207290 27926 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.194988 29668 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.210207 29727 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260503 07:58:01.211006 27926 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.213956 27959 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:01.211148 29695 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.220286 29695 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:01.220943 29727 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.224062 29676 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.210027 29723 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:01.231248 29708 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.234156 27856 catalog_manager.cc:5671] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:01.242345 29676 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:01.253656 29735 ts_tablet_manager.cc:1929] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260503 07:58:01.254179 29735 log.cc:1199] T 816629c788364a77be087fd62784f4de P adaf84b6ac60420ab03d39b9db9f0413: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/wals/816629c788364a77be087fd62784f4de
W20260503 07:58:01.255681 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:01.265882 29708 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:01.266719 29743 consensus_queue.cc:1059] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:58:01.272686 29668 consensus_queue.cc:1059] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:01.274580 29668 raft_consensus.cc:3055] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.274948 29668 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.275771 29668 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.280882 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:01.278018 29676 consensus_queue.cc:1059] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260503 07:58:01.285682 29723 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:01.279178 29724 raft_consensus.cc:1064] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:58:01.287304 27952 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:58:01.276975 29668 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.285348 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.293020 29482 raft_consensus.cc:3055] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.313647 29482 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.314002 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:01.314320 29482 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.315230 29482 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.269610 29708 raft_consensus.cc:3055] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:58:01.317230 29676 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.317324 29708 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.318838 27926 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.318581 29708 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.319898 27926 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.320091 29708 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.320902 27926 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.322767 29654 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.323076 29695 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.294863 29724 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:01.296030 29733 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:58:01.303316 27952 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:01.326649 27955 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:01.328977 29697 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:01.317869 29676 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:01.330749 29676 raft_consensus.cc:697] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.331588 29676 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:01.343411 28105 raft_consensus.cc:1240] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:01.345139 28108 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:01.351774 28105 raft_consensus.cc:1240] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:01.353168 28108 raft_consensus.cc:1240] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:01.354200 28614 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:58:01.352128 28075 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.355201 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.355737 28108 raft_consensus.cc:3055] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:58:01.356003 28108 raft_consensus.cc:740] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:01.357214 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.357537 28102 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:01.360852 27926 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.363071 29721 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.360191 28108 consensus_queue.cc:260] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.364377 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.367558 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:01.367926 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.371492 28029 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:01.372270 28033 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:01.372793 27844 catalog_manager.cc:5002] TS adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): tablet 816629c788364a77be087fd62784f4de (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:58:01.363826 29673 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.374768 28108 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.379739 28033 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:01.381068 29482 consensus_queue.cc:1059] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.386714 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.389627 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.388510 27926 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.398156 29482 raft_consensus.cc:3055] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.398483 29482 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.398743 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.388386 29697 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.399544 29721 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.401517 28106 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:01.401731 27926 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.392340 29647 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:01.400895 29740 consensus_queue.cc:1059] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.405700 29482 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.406797 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.409759 29482 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.410323 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.411528 29725 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.421180 28108 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:58:01.427009 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.404069 29685 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.432024 27926 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.405412 29743 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:01.403952 29703 consensus_queue.cc:1059] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260503 07:58:01.434499 29721 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.430122 29723 consensus_queue.cc:1059] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260503 07:58:01.465478 29703 raft_consensus.cc:3055] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.465874 29703 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.466188 29723 raft_consensus.cc:3055] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.466709 29703 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.467907 29703 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.453532 29743 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.453375 29685 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:01.473098 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 46197.4us
I20260503 07:58:01.466732 29723 raft_consensus.cc:740] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
W20260503 07:58:01.479120 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 47962.2us
I20260503 07:58:01.479203 29697 consensus_queue.cc:1059] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:01.479285 29723 consensus_queue.cc:260] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.480434 29697 raft_consensus.cc:3055] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.482046 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.483139 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.483831 29676 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:01.484162 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.484911 29676 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.485291 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.486019 29676 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.487008 28106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:01.487557 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.487567 28106 raft_consensus.cc:606] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.505457 29740 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.488786 29721 consensus_queue.cc:1059] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.506896 29721 raft_consensus.cc:3055] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.507217 29721 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.507946 29721 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.458048 29708 consensus_queue.cc:1059] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260503 07:58:01.509384 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:01.510031 29708 consensus_queue.cc:1243] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer be26cebb7c90445ea9a74f66463457c1 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260503 07:58:01.510903 29740 raft_consensus.cc:3055] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:01.511263 29740 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.511425 29721 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.489225 27926 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.513471 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.480767 29723 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.499156 29685 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.500157 29482 raft_consensus.cc:3055] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.517225 29482 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.503304 27959 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:01.480779 29697 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:01.514024 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.482882 29757 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:01.516517 27926 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.512006 29740 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.524972 29728 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.525111 29685 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.505236 29754 consensus_queue.cc:1059] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260503 07:58:01.525859 29722 raft_consensus.cc:3055] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.535710 29740 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:01.535921 29722 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.536739 29722 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.538065 29722 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.541944 27926 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.543704 29715 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.531894 29482 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.546257 29482 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.548080 29670 consensus_queue.cc:1059] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:01.549558 29728 raft_consensus.cc:3055] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:01.549893 29728 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.543756 29725 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:01.533314 29753 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:01.556190 29697 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.557195 29697 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.550916 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.552390 28106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:01.558784 28106 raft_consensus.cc:606] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:01.558903 29685 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.560413 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:01.561105 27959 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.561636 27952 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:01.565653 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:01.566493 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:01.568929 29685 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.571832 27959 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:58:01.572839 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:01.573249 29757 raft_consensus.cc:3055] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.573555 29757 raft_consensus.cc:740] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.574179 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:01.552577 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 46100.1us
I20260503 07:58:01.550663 29728 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.553577 29725 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:01.534754 27854 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:01.553928 29743 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.580282 29728 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:01.578723 27959 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:01.581233 29725 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.589131 29743 consensus_queue.cc:1059] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:01.590817 27959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:01.591715 27959 raft_consensus.cc:606] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.592201 27959 raft_consensus.cc:614] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:01.598438 28106 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:01.602344 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.604593 29676 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:01.606143 29676 consensus_queue.cc:1059] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.607404 29740 consensus_queue.cc:1059] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:01.608058 28614 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:58:01.608549 29703 raft_consensus.cc:3055] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.608891 29703 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.609738 29676 raft_consensus.cc:3055] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:01.610095 29676 raft_consensus.cc:740] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.611469 27959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:01.611980 27959 raft_consensus.cc:606] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:01.574548 29757 consensus_queue.cc:260] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.613546 29757 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.614408 29703 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:01.610810 29676 consensus_queue.cc:260] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.617739 29676 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:01.620431 29753 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.622596 28106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:01.623045 28106 raft_consensus.cc:606] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:01.627694 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:01.629061 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:01.630110 29482 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election won for term 2
I20260503 07:58:01.631188 29482 raft_consensus.cc:697] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.612612 29725 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:01.629161 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:01.633965 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:01.639868 29482 consensus_queue.cc:237] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.640626 29740 consensus_queue.cc:1059] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:01.631840 29758 raft_consensus.cc:3055] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.641438 29740 consensus_queue.cc:1243] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer be26cebb7c90445ea9a74f66463457c1 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260503 07:58:01.641492 29758 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.641949 29743 raft_consensus.cc:3055] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.642299 29743 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.643222 28028 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:58:01.643036 29743 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.644224 29743 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.643203 29758 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.646716 28035 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:01.648219 29758 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.645728 28029 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:01.645967 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:01.646445 28034 raft_consensus.cc:1240] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:01.646942 28032 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:01.644798 28033 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:01.654726 28026 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:01.656849 28034 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:58:01.656960 29725 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:01.629133 29757 consensus_queue.cc:1059] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260503 07:58:01.657923 29757 raft_consensus.cc:3055] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:58:01.658224 29757 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.658876 29757 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.659018 29722 consensus_queue.cc:1059] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:01.659822 29728 consensus_queue.cc:1059] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.660725 29728 consensus_queue.cc:1059] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.661401 29695 raft_consensus.cc:3055] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.661727 29695 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.661979 29670 raft_consensus.cc:3055] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:01.662096 29728 raft_consensus.cc:993] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:01.662350 29670 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.662684 29654 raft_consensus.cc:1081] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:01.662425 29695 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:01.663123 29670 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.663636 29695 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.664124 29670 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:01.664799 29697 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:58:01.665990 29715 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:01.666172 28106 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:01.666352 29715 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.667083 29715 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.668535 28614 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 LEARNER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260503 07:58:01.668675 29715 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:01.668900 29699 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.672418 29699 consensus_queue.cc:1059] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.673453 29753 raft_consensus.cc:3055] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:01.673784 29753 raft_consensus.cc:740] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:01.674510 29753 consensus_queue.cc:260] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.676488 29757 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.679242 27959 raft_consensus.cc:1275] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:01.680244 27952 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260503 07:58:01.677714 29753 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:01.689106 29705 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260503 07:58:01.689517 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:01.690331 29705 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.651361 29703 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:01.692482 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:01.694298 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.695024 29743 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.696000 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.696725 29743 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:58:01.698087 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.698658 29743 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:01.699605 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.700237 29743 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:01.702716 29743 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.704481 29743 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:01.705863 29705 raft_consensus.cc:993] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:01.706351 29705 raft_consensus.cc:1081] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:01.712016 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.716933 29705 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:01.722718 27952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45178
I20260503 07:58:01.723192 27952 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:01.723500 27952 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.730738 27952 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.732827 27952 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:01.743300 27924 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:01.744158 29695 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:58:01.749451 28614 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:01.760866 28033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:01.761042 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.761413 28033 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:01.761638 28108 raft_consensus.cc:3055] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.761878 29757 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:01.762311 28108 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:01.763012 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.764884 28034 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.765065 28108 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.765884 28108 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.763447 29697 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.772204 27854 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:01.768308 29672 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.761797 28033 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.770612 27857 catalog_manager.cc:5671] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 2, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 2 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:01.764022 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:01.791815 27943 tablet_service.cc:1558] Processing DeleteTablet for tablet 971ac26c5f9841959a1801eb548b0ff0 with delete_type TABLET_DATA_TOMBSTONED (TS 37e72845941344c9b0aaa7235a6f4473 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45162
I20260503 07:58:01.802470 27959 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.804236 28614 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:01.810859 29757 consensus_queue.cc:1059] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:01.811730 29482 raft_consensus.cc:3055] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:01.812026 29482 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.812706 29482 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:01.813778 29482 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:01.816768 27959 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:01.817766 28027 raft_consensus.cc:1240] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:01.822882 28031 raft_consensus.cc:2955] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:01.824796 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 971ac26c5f9841959a1801eb548b0ff0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:58:01.833186 28108 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:01.834302 28034 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:01.834465 27924 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:01.834944 28028 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260503 07:58:01.834574 28033 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.835265 29695 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:01.835750 29695 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.836575 28033 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:01.836570 29695 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.842624 28031 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:01.855726 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:01.856312 27959 raft_consensus.cc:3055] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:01.856683 27959 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:01.857414 27959 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.858500 27959 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.859114 28108 raft_consensus.cc:1275] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:01.856446 29764 tablet_replica.cc:333] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: stopping tablet replica
I20260503 07:58:01.861589 29697 consensus_queue.cc:1059] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:58:01.862584 29697 raft_consensus.cc:3055] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:58:01.862890 29697 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:01.863874 29697 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.865525 29697 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:01.874079 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:01.874727 28108 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:01.877470 29764 raft_consensus.cc:2243] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260503 07:58:01.878238 29764 raft_consensus.cc:2272] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:58:01.881719 29482 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:01.882325 28108 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:01.882902 29482 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:01.884526 29705 consensus_queue.cc:1059] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:01.886438 29705 raft_consensus.cc:3055] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:01.886760 29705 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:01.887573 29705 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.892714 29764 ts_tablet_manager.cc:1916] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:01.893352 29705 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:01.902216 29482 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:01.902338 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:01.864781 27959 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:01.913345 29757 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:01.913846 29757 raft_consensus.cc:697] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:01.914737 29757 consensus_queue.cc:237] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:01.959164 27857 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:02.003211 29764 ts_tablet_manager.cc:1929] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:58:02.003631 29764 log.cc:1199] T 971ac26c5f9841959a1801eb548b0ff0 P 37e72845941344c9b0aaa7235a6f4473: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/wals/971ac26c5f9841959a1801eb548b0ff0
I20260503 07:58:02.008206 27842 catalog_manager.cc:5002] TS 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): tablet 971ac26c5f9841959a1801eb548b0ff0 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:58:02.069325 28108 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:58:02.074440 29703 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260503 07:58:02.103749 27957 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260503 07:58:02.106093 29703 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:58:02.108211 27854 catalog_manager.cc:5671] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:02.179952 29728 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.180546 29728 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.184254 29728 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.185983 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.186592 28104 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:02.187423 27924 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.188292 29728 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:02.188717 29728 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.189150 29728 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:02.192427 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.192983 28034 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:02.227461 29728 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.238371 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:02.238876 28104 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:02.242128 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.242610 28033 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:02.247762 29728 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.265944 28033 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:02.269907 28104 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:02.282373 27926 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:02.287353 29728 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:02.288038 29728 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:02.288839 29728 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.313050 27957 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:02.315572 29482 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:02.324350 29697 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.324810 29697 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:02.326685 29697 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.327862 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.330160 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.331070 28034 raft_consensus.cc:2410] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260503 07:58:02.332062 28075 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:02.333120 29697 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:02.346076 29697 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:02.346508 29697 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.348326 29697 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:02.349637 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:02.353447 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.354099 28033 raft_consensus.cc:2393] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:02.357293 29728 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.357815 29728 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.359930 29728 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.350199 28614 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:02.370586 28073 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:02.371446 29697 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:02.371760 29697 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:02.372076 29697 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:02.375623 29753 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.376057 29753 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.377975 29753 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.378563 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.379180 27957 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:02.379325 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.379904 28034 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.380510 28073 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.381239 29753 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:02.381564 29753 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.381858 29753 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.359123 27854 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:02.360831 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.383263 28102 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:02.362193 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.384490 27924 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.385667 29721 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:02.386036 29721 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.386363 29721 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.384567 28033 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:02.368533 28104 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:02.388828 29482 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:02.396780 29721 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.403069 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.403431 28033 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.410038 28033 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:02.411003 27926 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:02.411761 29728 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:02.412274 29728 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:02.416201 29728 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.422269 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:02.422767 28102 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.420775 29697 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.425657 28108 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:58:02.426092 29721 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.430260 29697 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:02.431084 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:02.429567 29695 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260503 07:58:02.430276 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.434080 28034 raft_consensus.cc:2393] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:02.440325 28034 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:58:02.441648 28614 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:02.442474 28073 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:02.449385 29695 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:02.451025 29727 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:02.451485 29727 raft_consensus.cc:697] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.457476 28102 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:02.456007 29727 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.459652 29674 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:02.463452 29674 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.483839 29674 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.484179 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.484184 29705 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.484704 27957 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:02.484838 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.484937 29705 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.485498 28108 raft_consensus.cc:2393] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 4: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:02.486552 29699 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.486891 29705 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.486966 29699 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.488866 29699 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.489960 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.490010 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.490650 28033 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.490800 27854 catalog_manager.cc:5671] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:02.491875 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.492547 29753 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.493162 28075 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.494398 29753 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.495385 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.492573 27957 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:02.496771 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.497169 27957 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.497807 28033 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.498394 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.499819 29753 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:02.500236 29753 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.500524 29753 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.498875 28029 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.502229 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.502894 28034 raft_consensus.cc:2410] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260503 07:58:02.503800 28585 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:02.504424 29674 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:02.512017 29674 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:02.498796 28075 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:02.516484 29705 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:02.517731 29705 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.518668 29705 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.525328 28029 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.527148 28075 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.530943 27957 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.530275 29699 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:02.538751 29699 raft_consensus.cc:697] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.539698 29699 consensus_queue.cc:237] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.555954 29753 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.564646 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.565336 27952 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.570220 29697 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.570685 29697 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.574474 27952 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.576069 28073 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.576526 29707 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.600883 29727 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:02.601208 29697 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.601321 29727 raft_consensus.cc:697] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.602478 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.602972 28029 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.604244 28075 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.605180 29697 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:02.605513 29697 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.605798 29697 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.606866 29705 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.608685 29705 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.609217 29707 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.610136 29753 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.611403 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.612737 28035 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.615554 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.616258 28029 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.622064 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.622875 28031 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:02.629606 28075 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.630121 28029 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.602114 29727 consensus_queue.cc:237] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.633636 28035 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.638602 27854 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 2 to 3, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:02.640125 29697 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.620692 29707 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.641304 29788 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:02.641709 29788 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.642037 29788 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:02.644834 29482 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.647373 29697 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.647440 29482 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.649195 29482 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.649605 28075 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.650355 29789 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:02.650768 29789 raft_consensus.cc:697] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.651521 29789 consensus_queue.cc:237] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.660019 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.660530 27952 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:02.660811 29788 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.662070 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.662637 28104 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:02.665331 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.668331 28035 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.667416 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.669001 29482 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:02.665935 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.669337 29482 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.669557 28029 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:02.669714 29482 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.671453 27854 catalog_manager.cc:5671] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:02.672883 27854 catalog_manager.cc:5671] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:02.675374 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.678892 29790 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.679255 29482 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.679360 29790 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.680718 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.681250 29482 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.682348 29788 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.682564 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.684338 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.685038 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.688189 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.695935 27956 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.692844 29790 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.689433 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:02.707629 28102 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.708142 28029 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.711050 28075 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.711730 27956 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:02.712882 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:02.713830 28104 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:02.714283 29790 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.714740 29790 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.693222 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.714967 28102 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:02.715519 28033 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.716562 29697 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:02.717046 29697 raft_consensus.cc:697] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.717217 29790 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.717828 29697 consensus_queue.cc:237] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.691946 28035 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:02.722790 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.724732 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.726626 27956 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.727787 28073 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.727670 29695 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:02.728514 29788 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:02.728896 29788 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.729278 29788 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:02.731655 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:02.732231 29482 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:02.733103 28075 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:02.732659 29482 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:02.733515 27854 catalog_manager.cc:5671] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:02.734169 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.734884 28035 raft_consensus.cc:2393] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:02.734759 29482 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.736184 29790 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:02.736434 29789 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:02.736656 29790 raft_consensus.cc:697] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.736805 29789 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.737237 29789 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.737550 29790 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.740796 29758 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.741233 29758 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.744562 29758 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.747946 29697 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.748651 29697 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.749464 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.750073 27955 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:02.751192 29697 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.751608 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.752185 28104 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:02.752677 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.753268 27955 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.753594 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.754451 28073 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.755007 29758 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:02.755376 29758 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.755771 29758 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.755893 29707 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:02.756331 29707 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.756659 29707 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:02.764771 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.765666 28035 raft_consensus.cc:2393] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:02.752475 29789 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.774446 29789 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.780341 29788 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.788482 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.789350 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.789978 28033 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.794351 28031 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:02.800315 28033 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:02.801575 29727 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.802004 29727 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.802547 29707 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.803704 29727 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.804270 29707 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.804742 29783 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:02.807265 29758 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.813431 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.813614 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:02.814272 28035 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:58:02.815598 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.816215 28035 raft_consensus.cc:2393] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:02.816942 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:02.810838 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.825057 27956 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:58:02.825838 28033 raft_consensus.cc:2393] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:02.811350 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.811954 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:02.807452 27856 catalog_manager.cc:5671] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 2 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:02.827121 27854 catalog_manager.cc:5671] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:02.827841 27856 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 6, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:02.809337 29788 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.818605 29482 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.829200 27959 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.829602 29482 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.835973 29789 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.836032 27955 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.836519 29789 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:02.836063 28073 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.840091 28073 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.841985 29790 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:02.842360 29790 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.836715 29707 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:02.857467 29707 raft_consensus.cc:697] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.858201 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.858732 27955 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.844417 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:02.860138 28104 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:02.860394 28073 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:02.839233 29758 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.844988 29790 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:02.868836 27955 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:02.845075 29788 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:02.851322 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.852241 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:02.870020 29788 raft_consensus.cc:697] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.870323 28614 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:02.871209 29788 consensus_queue.cc:237] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.846468 29789 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:02.854657 29697 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.883529 29697 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.885978 29697 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:02.886346 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:02.886497 28102 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:02.858366 29707 consensus_queue.cc:237] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.890511 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.891059 27955 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:02.842669 29482 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:02.861828 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.891839 29790 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.881484 29695 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:02.892685 27959 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:02.862280 29727 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:02.893100 29695 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.882802 28104 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:02.887158 29757 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:02.889456 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:02.893772 29727 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.893958 29757 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.894165 28614 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:02.894348 29757 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.863489 28105 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:02.894927 29695 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.894654 29727 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.887187 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:02.900405 29695 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.900915 29695 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.903345 29783 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:02.905462 28073 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.906226 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.906327 28073 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.906809 28104 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:02.908111 29758 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:02.911128 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.915179 29728 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:02.917948 29728 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:02.918325 29728 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:02.916911 29697 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:02.942268 29697 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:02.942651 29697 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.915292 29721 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:02.945314 29721 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.947216 29721 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.918819 29789 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:02.947697 29789 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.948104 29789 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:02.949188 27955 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:02.951387 28614 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260503 07:58:02.951457 29753 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:02.953763 29753 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:02.958444 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.961884 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:02.962587 27955 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 3
I20260503 07:58:02.970074 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:02.972005 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:02.959033 29758 raft_consensus.cc:697] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:02.969578 29695 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.983311 27955 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:02.980887 29788 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.984754 29790 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.984814 29788 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.987452 29788 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.984381 28073 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:02.990005 29788 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:02.990955 29788 raft_consensus.cc:697] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:02.991727 29728 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.975894 29707 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:02.992674 29707 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:02.993701 29728 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:02.988696 29697 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.994570 29707 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.997112 29697 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:02.991727 29757 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:02.998016 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:02.998646 27955 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:02.998842 29757 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:02.999512 29697 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.000048 29697 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.000793 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.001362 27955 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:03.002985 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.003481 27955 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.000959 29758 consensus_queue.cc:237] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.006263 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.012156 28073 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.013724 28073 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.016435 27955 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:03.017297 29753 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:03.018582 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.020098 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:03.020678 28619 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.021522 29789 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:03.023335 29789 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:03.018803 29699 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:03.024096 29699 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:03.024422 29699 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:03.026990 28619 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:03.017134 29697 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:02.992455 29788 consensus_queue.cc:237] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.030793 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.031009 28073 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.006873 29728 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:03.012997 29721 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:03.019357 29753 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:03.041419 29753 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:03.041227 29721 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.043136 29721 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.044075 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.044624 28102 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:03.045584 27924 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.047258 29721 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:03.047652 29721 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:03.046114 29728 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.048007 29721 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.049340 29728 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.053273 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.053807 28102 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:03.055323 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.033761 29697 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:03.057365 27856 catalog_manager.cc:5671] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 6, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:03.037323 28105 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:03.060470 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.060990 27956 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:03.062119 29716 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:03.058831 27856 catalog_manager.cc:5671] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:03.062914 29716 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:03.063771 29716 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.065228 29721 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.067019 29721 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.066771 29699 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.071836 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.072501 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.072713 28073 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.069061 29699 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:03.090632 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 185700us
I20260503 07:58:03.080669 28105 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:03.102401 27956 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:03.061885 29728 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:03.110000 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.110566 28029 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:03.111508 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.112154 28027 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.112282 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.113204 28030 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.113301 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.114128 28031 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.114632 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.115185 28033 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:03.115886 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.116511 28033 raft_consensus.cc:2393] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.120417 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.112807 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.122316 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:03.123075 28614 raft_consensus.cc:2393] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:03.123848 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.069674 29697 raft_consensus.cc:697] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:03.129226 28026 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:03.117183 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.130824 28033 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:03.131524 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.131752 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.132176 28034 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.121142 28035 raft_consensus.cc:2393] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.125494 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.133934 28029 raft_consensus.cc:2393] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.126469 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.130054 29482 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.125699 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.135380 28031 raft_consensus.cc:2393] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.131366 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.137172 28032 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.137080 28028 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.108095 29757 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.137104 28027 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:03.139276 28034 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260503 07:58:03.136195 27926 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.134557 29482 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:03.109445 29728 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:03.107964 29721 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:58:03.142869 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 70217.1us
I20260503 07:58:03.143838 28033 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:03.144024 27924 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.144508 28105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:03.145102 28105 raft_consensus.cc:606] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:03.148736 28073 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.148602 29721 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.163758 29809 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:03.164384 29809 raft_consensus.cc:697] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:03.165463 29809 consensus_queue.cc:237] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.147085 29788 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:03.144946 29728 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:03.147912 29813 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:03.172125 29818 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.174919 29818 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.177326 29818 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.188463 29482 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:03.145187 29757 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.178821 29813 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.179009 29816 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
W20260503 07:58:03.209465 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 65512.1us
I20260503 07:58:03.210299 28030 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:03.190366 29788 raft_consensus.cc:697] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:03.217064 29804 log.cc:927] Time spent T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.136s user 0.000s sys 0.001s
I20260503 07:58:03.218565 29757 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.209628 29813 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.222007 29783 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:03.222538 29783 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.224311 29783 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.224021 27857 catalog_manager.cc:5671] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.225754 29721 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.197477 29697 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:03.247167 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 106392us
I20260503 07:58:03.248634 27926 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:03.252564 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 113815us
I20260503 07:58:03.233145 29814 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:03.233542 29816 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:03.256611 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 107950us
I20260503 07:58:03.258510 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.260111 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.260502 29758 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.261085 29758 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.261358 29788 consensus_queue.cc:237] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:03.262878 29758 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.264556 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.266080 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.266312 28030 raft_consensus.cc:1275] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:03.266685 28105 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:03.229000 29753 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.271183 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.245752 29802 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.273826 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.274530 29482 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:03.274893 29482 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.275188 29482 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.282485 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.282191 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.286329 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:03.278743 27956 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.290411 28030 raft_consensus.cc:2368] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:58:03.292032 29482 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.292870 28027 raft_consensus.cc:2368] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:03.245453 29813 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.295737 29482 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.268640 29814 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.297353 29826 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260503 07:58:03.298218 29753 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:03.298759 29814 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:03.299870 29813 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.309068 27956 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.311944 29728 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.278254 29806 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:03.316846 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.319846 29753 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:03.320415 29753 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.319962 29816 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.320842 29753 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.317821 29783 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:03.320552 29820 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:03.319439 27956 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:03.286860 29716 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:03.344897 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.345579 27957 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:03.350863 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.351675 27957 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:03.288107 29705 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260503 07:58:03.357386 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.372437 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.293330 29727 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260503 07:58:03.372956 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:03.323119 29783 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.342180 29716 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.388098 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.388674 27956 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:03.390926 29783 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.383198 28027 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.278893 29802 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.393504 29802 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.385022 29482 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:03.398602 29482 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.398900 29482 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.386586 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:03.346899 29813 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:03.368875 29695 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:03.400523 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.402211 27955 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.403949 28027 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:03.413498 29482 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.383831 29825 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:03.369390 29822 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.417471 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.415799 29482 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.397637 29716 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.428571 27952 raft_consensus.cc:2368] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
W20260503 07:58:03.432129 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 142977us
I20260503 07:58:03.407893 29802 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:03.435065 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.436228 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.357173 29821 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260503 07:58:03.440889 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.441620 28104 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.442705 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.442875 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.437783 29802 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.443437 28027 raft_consensus.cc:2393] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.431232 29806 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.346688 29820 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.411837 29813 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.444279 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.463943 28031 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:03.470227 28030 raft_consensus.cc:2368] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:58:03.454867 28104 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:03.457064 29806 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:03.443331 29838 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:03.487071 29838 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:03.488325 29806 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:03.459236 29817 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.490087 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:03.490660 28614 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:58:03.460863 28073 leader_election.cc:400] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:58:03.491436 28073 leader_election.cc:403] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:03.494817 29838 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.496073 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.496589 28030 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:03.496451 27854 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:03.497440 27924 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.497773 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.497978 27957 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.498162 27854 catalog_manager.cc:5671] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:03.499822 27854 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.500947 29699 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:58:03.460793 29727 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.417891 29695 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:03.438129 29822 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.504074 29695 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:03.504560 29695 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:03.444376 28108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:03.461736 29728 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.446297 29802 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:03.505005 29695 raft_consensus.cc:697] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:03.484261 29820 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.418463 29753 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.545984 29695 consensus_queue.cc:237] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.547631 29753 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:03.449157 29758 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.548283 29758 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:03.486284 29813 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.550756 29758 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:03.552065 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.552809 28103 raft_consensus.cc:2368] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5.
I20260503 07:58:03.553632 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:03.555064 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.555789 28103 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:03.558895 27924 leader_election.cc:400] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5.
I20260503 07:58:03.559196 27924 leader_election.cc:403] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:03.561220 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.504715 29822 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.427124 29825 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.561936 28103 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 3: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:03.563496 29825 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.513705 27856 catalog_manager.cc:5671] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.505267 28108 raft_consensus.cc:606] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:03.537590 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:03.565207 28614 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:03.509445 27952 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:58:03.543428 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.571033 28033 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.544212 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.573729 28583 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.575352 29786 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:03.575789 29786 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:03.576159 29786 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:03.583751 28102 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:03.587630 29802 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.589226 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.590062 29825 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:03.590569 29825 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:03.590862 27957 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:03.591475 29813 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5.
I20260503 07:58:03.591553 29825 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.480517 29716 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.596875 27959 raft_consensus.cc:2368] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:58:03.598707 29786 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:03.617666 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.618160 27959 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:03.625952 27959 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:03.600268 29716 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.606949 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.628034 28027 raft_consensus.cc:2393] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.606813 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.607246 28030 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.630357 28102 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
W20260503 07:58:03.608644 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 224170us
I20260503 07:58:03.631711 27926 leader_election.cc:400] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:58:03.632135 27926 leader_election.cc:403] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:03.609418 29802 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.584815 27856 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 6, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:03.632688 29721 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:58:03.634032 27926 leader_election.cc:400] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:03.634339 27926 leader_election.cc:403] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:03.633569 27856 catalog_manager.cc:5671] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.615418 28073 leader_election.cc:400] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:58:03.634770 28073 leader_election.cc:403] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260503 07:58:03.635219 29721 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 6
I20260503 07:58:03.636677 29840 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.639736 29697 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:03.641288 28075 leader_election.cc:400] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:58:03.642784 29721 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:03.642984 29697 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.643592 29840 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4.
I20260503 07:58:03.645517 27924 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.645963 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.649309 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.649963 28106 raft_consensus.cc:2393] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:03.650560 29815 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:03.650914 29815 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:03.651257 29815 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:03.651400 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.652274 27854 catalog_manager.cc:5671] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.653283 29828 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:03.653697 27854 catalog_manager.cc:5671] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.655514 28108 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:03.644774 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:03.656884 28102 raft_consensus.cc:606] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:03.662966 28614 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:58:03.664700 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.665701 28101 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:03.666206 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.667038 29757 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:03.667265 27924 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.667408 29757 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.667685 29815 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.668097 29757 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:03.668853 29843 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:03.669327 29843 raft_consensus.cc:697] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:03.670019 29843 consensus_queue.cc:237] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.671744 29802 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.672164 29802 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.674413 29802 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.675052 29757 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:03.676752 29757 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:03.677270 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.687278 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.678095 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.687832 28105 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:03.678109 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.678665 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.688627 28027 raft_consensus.cc:2368] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:03.688627 28030 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.679312 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.680384 28104 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.690953 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.691264 27952 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.690630 28102 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:03.691860 29834 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.681737 29697 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:03.683524 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.684662 28108 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:03.697801 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.699330 27952 raft_consensus.cc:1275] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:03.686067 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.686561 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.686962 28103 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:03.700023 28033 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:03.703801 28585 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.685205 29786 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.684958 27957 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.704566 29838 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:03.705338 29838 raft_consensus.cc:697] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:03.705488 29815 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.706312 29838 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:03.720238 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.733788 28027 raft_consensus.cc:1275] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:03.733999 27957 raft_consensus.cc:1275] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:03.735143 28027 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:03.736104 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.736797 27952 raft_consensus.cc:2393] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.738570 27952 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:03.740732 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.741883 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.746321 27856 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.747022 27958 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:03.741896 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.742879 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.748009 27856 catalog_manager.cc:5671] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.748792 27953 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:03.749604 28027 raft_consensus.cc:1275] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:58:03.740993 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.741554 27951 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:03.758045 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.758584 27956 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:03.760336 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.760874 27958 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:03.765625 27954 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:03.762487 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.768260 29757 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:03.768328 27953 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:03.768757 29757 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.769233 29757 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.770978 27958 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:03.739705 27957 raft_consensus.cc:1275] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:58:03.779585 29757 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.800653 29753 consensus_queue.cc:1048] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:03.802358 29753 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.803054 29753 raft_consensus.cc:3055] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:03.803367 29753 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:03.804087 29753 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.780947 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.784459 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.785077 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.806578 28105 raft_consensus.cc:1275] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.808853 27955 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 6
I20260503 07:58:03.808971 27926 leader_election.cc:400] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:03.809430 27926 leader_election.cc:403] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:03.810531 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:03.812139 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.817660 29482 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.818382 27955 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:03.822521 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.825203 29482 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:03.825562 29697 raft_consensus.cc:993] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:03.817513 27857 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 2 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4), now has a pending config: VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1), VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2), VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3), VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 3 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:03.811801 29753 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.825671 29482 raft_consensus.cc:697] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:03.828269 29482 consensus_queue.cc:237] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.826030 29697 raft_consensus.cc:1081] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:03.824584 29818 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:03.818552 29822 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:03.815716 29843 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:03.818749 29758 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:03.834980 27955 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:58:03.820221 29716 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:03.825347 29825 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260503 07:58:03.834734 29822 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.835928 29758 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:03.826396 29802 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260503 07:58:03.850023 27955 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:03.841835 29818 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:03.853945 29818 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.855652 29818 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.847064 29758 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:03.851717 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.858981 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.861253 29806 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:03.861829 29806 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.862957 29806 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:03.863247 29806 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:03.863570 29806 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.844208 29840 consensus_queue.cc:1048] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260503 07:58:03.846925 29822 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.846264 29757 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.898617 27957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:03.899369 27957 raft_consensus.cc:606] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:03.903241 29697 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.906111 29814 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.912583 29806 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.920631 29840 raft_consensus.cc:993] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:03.921178 29840 raft_consensus.cc:1081] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:03.922768 28073 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:03.926275 29697 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:03.927773 27955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:03.932680 27955 raft_consensus.cc:606] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:03.934244 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 74377.2us
I20260503 07:58:03.935667 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.937312 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:03.937093 27857 catalog_manager.cc:5671] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:03.938282 29697 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:03.939425 29482 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:03.939940 29482 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:03.940414 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:03.941522 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.943634 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.941838 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:03.944572 28027 raft_consensus.cc:2393] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.942000 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:03.945428 28030 raft_consensus.cc:1275] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:03.946062 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:03.943171 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.941112 29697 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260503 07:58:03.948987 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:03.949679 28034 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.953421 28100 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:03.946514 28035 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:03.934729 29758 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.960093 29758 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:03.960445 29727 consensus_queue.cc:1059] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:03.961153 29727 raft_consensus.cc:3055] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:03.961447 29727 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:03.949054 29482 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.964067 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.966580 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.968369 28028 raft_consensus.cc:2393] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:03.962100 29727 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:03.969050 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:03.970010 27955 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:58:03.970216 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:03.970741 28106 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 2.
I20260503 07:58:03.939200 29861 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:03.971331 29861 raft_consensus.cc:697] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
W20260503 07:58:03.971402 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:03.972185 29861 consensus_queue.cc:237] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:03.977511 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.978011 27957 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.978997 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:03.979519 28105 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:03.939474 29802 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260503 07:58:03.937280 29817 consensus_queue.cc:1048] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260503 07:58:03.981148 29716 raft_consensus.cc:993] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:03.981644 29716 raft_consensus.cc:1081] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:03.981701 29727 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:03.937449 29827 consensus_queue.cc:1048] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260503 07:58:03.984417 29695 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.987444 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:03.988607 29825 consensus_queue.cc:1059] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:03.989478 29825 raft_consensus.cc:3055] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:03.989789 29825 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:03.990798 29825 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:03.935236 29840 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260503 07:58:03.992561 27954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45178
I20260503 07:58:03.993567 27954 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:03.992669 29825 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:03.993868 27954 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:03.998847 27957 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:03.999491 27953 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:03.999603 28105 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:04.000926 27924 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:04.008163 28028 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:04.009371 28034 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:04.009495 28027 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:04.013077 28031 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260503 07:58:04.013505 28031 pending_rounds.cc:85] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 4
I20260503 07:58:04.013768 28031 pending_rounds.cc:107] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260503 07:58:04.014007 28031 raft_consensus.cc:2917] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260503 07:58:04.014458 28031 raft_consensus.cc:2889] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:04.015986 28027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:04.016474 28027 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:04.012930 29802 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:04.019471 29802 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.021307 29802 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:04.016830 28027 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:04.034260 27954 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.036914 27952 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:04.041093 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33286 (request call id 411) took 3105 ms. Trace:
I20260503 07:58:04.037313 28027 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.045943 27954 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:04.047477 28027 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:04.014246 29695 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election won for term 2
W20260503 07:58:04.112104 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 61194.6us
I20260503 07:58:04.048648 29822 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:04.117543 28033 raft_consensus.cc:2368] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:58:04.041363 29806 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:04.045145 28031 rpcz_store.cc:276] 0503 07:58:00.909466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:00.912336 (+ 2870us) service_pool.cc:224] Handling call
0503 07:58:00.953508 (+ 41172us) log.cc:844] Serialized 487 byte log entry
0503 07:58:01.103332 (+149824us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b1800309160. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:58:04.014911 (+2911579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":296,"raft.run_cpu_time_us":1006,"raft.run_wall_time_us":14552,"spinlock_wait_cycles":10634880,"thread_start_us":61817,"threads_started":1,"wal-append.queue_time_us":134228,"wal-append.run_cpu_time_us":1490,"wal-append.run_wall_time_us":1019495}
I20260503 07:58:04.125174 29695 raft_consensus.cc:697] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:04.072676 29790 consensus_queue.cc:1059] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260503 07:58:04.159539 29822 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:04.178568 29859 log.cc:927] Time spent T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.286s user 0.001s sys 0.000s
I20260503 07:58:04.219703 28034 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:04.149407 29817 consensus_queue.cc:1059] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260503 07:58:04.194465 29810 raft_consensus.cc:3055] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:04.226924 28034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:04.225366 29810 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:04.227463 28034 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:04.227856 28034 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:04.229180 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:04.229713 28031 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:04.229802 28032 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:04.231694 28032 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:04.235092 28030 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:04.245550 28031 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:04.252050 28030 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:04.257632 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:04.256444 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:04.257567 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:04.258683 27954 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:04.258255 27952 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:04.259898 27926 leader_election.cc:400] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
I20260503 07:58:04.260183 27926 leader_election.cc:403] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:04.262809 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:04.265434 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:04.267678 29482 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:04.268150 29482 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:04.268544 29482 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:04.278900 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:04.279775 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:04.228154 29810 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.280009 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:04.280781 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:04.281338 28107 raft_consensus.cc:3055] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:04.281610 28107 raft_consensus.cc:740] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:04.283854 27952 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:04.288506 27954 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:04.290230 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:04.291580 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 178617us
I20260503 07:58:04.291752 28034 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.292815 28035 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:04.295674 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:04.335592 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 45459.4us
I20260503 07:58:04.295450 28107 consensus_queue.cc:260] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.343616 28108 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:04.294574 29482 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.345885 29482 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:04.289186 29818 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:04.348132 28107 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:04.350009 28034 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:04.352399 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 62239.7us
I20260503 07:58:04.352967 29697 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:04.355511 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:04.286844 29834 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4.
W20260503 07:58:04.279971 27844 catalog_manager.cc:5201] ChangeConfig:REMOVE_PEER RPC for tablet 9376e27fcb734be296a0612be76962b1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
W20260503 07:58:04.358836 29870 log.cc:927] Time spent T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.121s user 0.000s sys 0.000s
I20260503 07:58:04.255023 29695 consensus_queue.cc:237] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:04.360172 29869 log.cc:927] Time spent T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.135s user 0.000s sys 0.000s
I20260503 07:58:04.355599 29810 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:04.369524 29864 log.cc:927] Time spent T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.151s user 0.000s sys 0.000s
I20260503 07:58:04.267953 29786 consensus_queue.cc:1059] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260503 07:58:04.289522 29802 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:04.348699 29757 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:04.387890 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:04.486322 28102 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:04.389151 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:04.389892 28108 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
W20260503 07:58:04.401882 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:04.418526 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:04.433125 28107 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:04.488858 28109 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:04.490875 28107 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:04.451548 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:04.451772 27844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 184403us
W20260503 07:58:04.485590 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 89805.8us
I20260503 07:58:04.491663 28104 raft_consensus.cc:3055] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:04.491925 28104 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:04.489807 28101 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
W20260503 07:58:04.491219 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 72883.6us
I20260503 07:58:04.496719 28102 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:04.497982 28102 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:04.498623 29757 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:04.504912 29757 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:04.506016 29867 log.cc:927] Time spent T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.144s user 0.002s sys 0.008s
I20260503 07:58:04.507531 29802 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:04.407680 29843 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260503 07:58:04.509898 27999 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:04.514386 28106 raft_consensus.cc:1275] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:04.507566 28108 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260503 07:58:04.517161 27905 auto_rebalancer.cc:786] Removing replace marker failed: Couldn't find leader for tablet 7bd4f1f94ce446d19045339767e2f84a
W20260503 07:58:04.517469 27905 auto_rebalancer.cc:814] Could not move replica: Not found: Couldn't find leader for tablet 7bd4f1f94ce446d19045339767e2f84a
W20260503 07:58:04.517729 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet 7bd4f1f94ce446d19045339767e2f84a
I20260503 07:58:04.518172 29822 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:04.518381 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:04.518618 29822 raft_consensus.cc:697] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:04.519702 29802 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:04.519526 29822 consensus_queue.cc:237] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.520141 29802 raft_consensus.cc:697] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:04.493848 29818 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:04.522176 29818 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.526994 29889 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260503 07:58:04.529495 29877 log.cc:927] Time spent T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.164s user 0.000s sys 0.001s
W20260503 07:58:04.531188 29871 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.245s user 0.000s sys 0.001s
I20260503 07:58:04.520949 29802 consensus_queue.cc:237] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:04.545192 29876 log.cc:927] Time spent T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.057s user 0.001s sys 0.000s
W20260503 07:58:04.552865 29881 log.cc:927] Time spent T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.182s user 0.001s sys 0.005s
W20260503 07:58:04.562637 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 120445us
I20260503 07:58:04.563199 28109 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:04.589820 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:04.573278 29825 consensus_meta.cc:287] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.579s user 0.008s sys 0.001s
I20260503 07:58:04.587620 29721 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260503 07:58:04.634864 29758 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:04.608052 29716 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260503 07:58:04.665166 29811 consensus_queue.cc:1059] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260503 07:58:04.665969 29811 raft_consensus.cc:3055] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:04.666311 29811 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:04.667011 29811 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.668007 29811 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:04.670935 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 160658us
W20260503 07:58:04.659695 29875 log.cc:927] Time spent T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260503 07:58:04.659921 29758 raft_consensus.cc:697] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
W20260503 07:58:04.678200 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 391190us
W20260503 07:58:04.682210 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 150744us
W20260503 07:58:04.734193 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 60533.5us
I20260503 07:58:04.738324 28102 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:04.774677 29828 raft_consensus.cc:993] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:04.775125 29828 raft_consensus.cc:1081] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:04.776544 28033 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260503 07:58:04.790627 28105 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
W20260503 07:58:04.831482 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 96296.4us
I20260503 07:58:04.793660 29894 consensus_queue.cc:1059] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260503 07:58:04.772200 29699 consensus_queue.cc:1059] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260503 07:58:04.831743 29861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s user 0.019s sys 0.042s
I20260503 07:58:04.867278 28028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:04.867871 28028 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:04.868297 28028 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:04.843961 29861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s user 0.020s sys 0.043s
W20260503 07:58:04.870249 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 135437us
I20260503 07:58:04.872205 27926 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:04.890743 29868 log.cc:927] Time spent T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.542s user 0.000s sys 0.002s
I20260503 07:58:04.891367 29834 consensus_queue.cc:1059] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:04.897420 29844 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:04.897800 29844 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:04.898504 29844 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.901718 29901 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260503 07:58:04.903466 29901 raft_consensus.cc:3055] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:04.903843 29901 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:04.905177 29873 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.169s
I20260503 07:58:04.857702 29699 consensus_queue.cc:1243] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer adaf84b6ac60420ab03d39b9db9f0413 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260503 07:58:04.908372 28027 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:04.835601 29758 consensus_queue.cc:237] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.951373 28104 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:04.955828 28104 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:04.962807 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 473375us
I20260503 07:58:04.952819 27857 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 6 to 7, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 7 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:04.975973 27958 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
W20260503 07:58:04.983525 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 124236us
W20260503 07:58:04.999105 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:05.010298 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 138204us
I20260503 07:58:04.904678 29901 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.020530 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:05.023142 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:05.026139 27957 raft_consensus.cc:1275] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260503 07:58:05.031217 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.031888 27957 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:05.032572 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:05.033244 28104 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:05.044329 27959 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:05.063576 27960 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:05.028651 29901 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:05.050891 29802 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
W20260503 07:58:05.053004 29814 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260503 07:58:05.102465 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 87492us
W20260503 07:58:05.110737 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 108102us
I20260503 07:58:05.118955 29482 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:05.131938 28028 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.109941 29802 raft_consensus.cc:697] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:05.117142 28100 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:05.141629 28028 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:05.175554 29900 log.cc:927] Time spent T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.211s user 0.000s sys 0.001s
W20260503 07:58:05.185667 29906 log.cc:927] Time spent T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.161s user 0.000s sys 0.000s
W20260503 07:58:05.189622 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 67811.5us
W20260503 07:58:05.192214 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 197213us
I20260503 07:58:05.193126 29920 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:05.193638 29920 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:05.195156 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 78127.9us
I20260503 07:58:05.206910 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:05.207615 28103 raft_consensus.cc:3055] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:05.207907 28103 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:05.209537 28028 raft_consensus.cc:1240] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:05.211845 29757 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:05.210115 28103 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.213553 28103 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:05.212373 29915 log.cc:927] Time spent T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.106s user 0.000s sys 0.001s
I20260503 07:58:05.185905 29802 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:05.232721 29878 raft_consensus.cc:3055] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:05.233126 29878 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:05.235661 29920 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:05.216164 29758 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
W20260503 07:58:05.246388 29899 log.cc:927] Time spent T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.411s user 0.002s sys 0.001s
I20260503 07:58:05.233930 29878 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:05.277899 28103 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:05.286113 29936 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:05.286638 29936 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.288990 29936 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:05.293277 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 97442.6us
W20260503 07:58:05.044095 29908 consensus_queue.cc:1175] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "adaf84b6ac60420ab03d39b9db9f0413" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260503 07:58:05.295316 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:05.295918 27953 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:05.297631 27957 raft_consensus.cc:3055] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:05.297935 27957 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:05.298182 27958 raft_consensus.cc:1275] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:05.298527 27957 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.299314 27959 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260503 07:58:05.299401 27957 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:05.299659 27959 pending_rounds.cc:85] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Aborting all ops after (but not including) 5
I20260503 07:58:05.299885 27959 pending_rounds.cc:107] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260503 07:58:05.300098 27959 raft_consensus.cc:2889] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:05.303202 29920 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:05.303380 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.303682 29920 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.306151 27956 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:05.309484 29936 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:05.309966 29936 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.312177 29936 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:05.305707 29920 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:05.324573 27957 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260503 07:58:05.332183 27957 pending_rounds.cc:85] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Aborting all ops after (but not including) 1
I20260503 07:58:05.332538 27957 pending_rounds.cc:107] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260503 07:58:05.333104 27957 raft_consensus.cc:2889] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:05.337960 28108 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:05.338392 28108 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:05.339026 28108 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.340351 28108 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:05.323109 27953 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:05.358213 28108 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260503 07:58:05.362294 28108 pending_rounds.cc:85] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Aborting all ops after (but not including) 4
I20260503 07:58:05.363804 28108 pending_rounds.cc:107] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260503 07:58:05.365504 28108 raft_consensus.cc:2889] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:05.359403 29920 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:05.362182 29936 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:05.399674 28583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:05.408805 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 210192us
I20260503 07:58:05.411751 27953 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:05.387537 29936 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.387712 29920 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:05.416802 28582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:05.423306 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 207389us
W20260503 07:58:05.427166 29884 log.cc:927] Time spent T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
W20260503 07:58:05.434785 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.437088 29936 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:05.446058 28108 raft_consensus.cc:1275] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:05.445490 29818 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:05.455916 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.455977 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:05.456705 28108 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260503 07:58:05.456673 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:05.462343 28031 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:05.464483 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:05.465214 29482 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:05.465835 29482 raft_consensus.cc:697] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:05.470095 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:05.470723 28034 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:05.471604 29866 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:05.467247 29815 raft_consensus.cc:993] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:05.464830 29818 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.474463 29818 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:05.485016 29482 consensus_queue.cc:237] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.486518 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:05.487421 28033 raft_consensus.cc:2393] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:05.484187 29815 raft_consensus.cc:1081] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:05.516459 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:05.513290 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:05.514446 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:05.519644 27952 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:05.515206 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:05.520807 27955 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:05.464422 29802 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260503 07:58:05.555804 29929 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:05.556350 29929 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:05.561162 29941 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.111s user 0.001s sys 0.000s
I20260503 07:58:05.582736 28109 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260503 07:58:05.594067 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.483472 29758 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260503 07:58:05.516335 29783 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:05.598793 28105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43222 (request call id 1176) took 1303 ms. Trace:
I20260503 07:58:05.604919 28105 rpcz_store.cc:276] 0503 07:58:04.279698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:04.279806 (+ 108us) service_pool.cc:224] Handling call
0503 07:58:05.582256 (+1302450us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b540016bcd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:05.583432 (+ 1176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148342144}
I20260503 07:58:05.508656 29757 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260503 07:58:05.558090 29929 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:05.633170 29783 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.647364 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:05.648598 29783 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:05.648447 29944 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260503 07:58:05.655603 29920 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:05.656059 29902 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:05.666605 29902 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:05.673799 29893 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260503 07:58:05.649123 29822 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260503 07:58:05.824394 28107 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260503 07:58:05.833853 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.830063 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:05.838518 28102 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
W20260503 07:58:05.847563 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:05.855700 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.869802 29883 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:05.870309 29883 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:05.882776 29822 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:05.884411 29822 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.886224 29822 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:05.886157 28103 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:05.872843 29883 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:05.889925 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:05.894915 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 66093.4us
I20260503 07:58:05.901924 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:05.903112 28108 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:05.899641 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:05.888728 29929 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:05.905148 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:05.906260 28102 pending_rounds.cc:85] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1: Aborting all ops after (but not including) 3
I20260503 07:58:05.916606 28108 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260503 07:58:05.917670 28102 pending_rounds.cc:107] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260503 07:58:05.917925 28102 raft_consensus.cc:2889] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:05.922971 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:05.928973 27959 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260503 07:58:05.930205 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:05.898752 29902 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:05.898958 29883 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:05.904309 29789 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:05.937048 29889 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:05.933418 28582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.943753 29889 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:05.949635 29789 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:05.922345 29929 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:05.964720 28582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:05.990427 28583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:05.997356 29889 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.000339 29789 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:06.001174 29929 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.008086 27958 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:05.945508 29883 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:06.018748 29883 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:06.019152 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 1557) took 1967 ms. Trace:
I20260503 07:58:06.019512 28027 rpcz_store.cc:276] 0503 07:58:04.051837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:04.122706 (+ 70869us) service_pool.cc:224] Handling call
0503 07:58:04.123428 (+ 722us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:04.909794 (+786366us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:06.018940 (+1109146us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540024b8d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:06.019085 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804544384}
W20260503 07:58:06.062393 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 141152us
I20260503 07:58:06.064949 29968 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:06.065454 29968 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.067201 29878 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:06.067695 29968 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.058856 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:06.080888 29971 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:06.081405 29971 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.084261 29971 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:06.085664 28075 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:06.088886 29971 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:06.089273 29971 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:06.089617 29971 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.092680 29969 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:06.093261 29969 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.097055 29969 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:06.100119 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 256) took 1921 ms. Trace:
I20260503 07:58:06.100374 27857 rpcz_store.cc:276] 0503 07:58:04.179025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:04.179174 (+ 149us) service_pool.cc:224] Handling call
0503 07:58:06.100054 (+1920880us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:05.186422 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:05.187000 (+ 578us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:05.187045 (+ 45us) write_op.cc:435] Acquired schema lock
0503 07:58:05.187058 (+ 13us) tablet.cc:662] Decoding operations
0503 07:58:05.187361 (+ 303us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:05.187410 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:05.187436 (+ 26us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:58:05.187623 (+ 187us) tablet.cc:701] Row locks acquired
0503 07:58:05.187635 (+ 12us) write_op.cc:260] PREPARE: finished
0503 07:58:05.187757 (+ 122us) write_op.cc:270] Start()
0503 07:58:05.191602 (+ 3845us) write_op.cc:276] Timestamp: P: 1777795085187718 usec, L: 0
0503 07:58:05.191630 (+ 28us) op_driver.cc:348] REPLICATION: starting
0503 07:58:05.237000 (+ 45370us) log.cc:844] Serialized 535 byte log entry
0503 07:58:05.843088 (+606088us) op_driver.cc:464] REPLICATION: finished
0503 07:58:06.094419 (+251331us) write_op.cc:301] APPLY: starting
0503 07:58:06.094505 (+ 86us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:06.094595 (+ 90us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:06.094705 (+ 110us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:06.094925 (+ 220us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:06.095263 (+ 338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:58:06.097302 (+ 2039us) write_op.cc:312] APPLY: finished
0503 07:58:06.097473 (+ 171us) log.cc:844] Serialized 23 byte log entry
0503 07:58:06.097623 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:06.097830 (+ 207us) write_op.cc:454] Released schema lock
0503 07:58:06.097869 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:06.098169 (+ 300us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:06.098185 (+ 16us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71054,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":250804,"apply.run_cpu_time_us":1563,"apply.run_wall_time_us":4033,"num_ops":1,"prepare.queue_time_us":170490,"prepare.run_cpu_time_us":17140,"prepare.run_wall_time_us":281023,"raft.queue_time_us":280535,"raft.run_cpu_time_us":32049,"raft.run_wall_time_us":227727,"replication_time_us":650236,"thread_start_us":799178,"threads_started":4,"wal-append.queue_time_us":208978}]]}
I20260503 07:58:06.110410 29965 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:06.116906 29971 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.120644 28109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43222 (request call id 1192) took 1113 ms. Trace:
I20260503 07:58:06.121004 28109 rpcz_store.cc:276] 0503 07:58:05.007160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:05.007301 (+ 141us) service_pool.cc:224] Handling call
0503 07:58:05.582378 (+575077us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:05.583121 (+ 743us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:06.120441 (+537320us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b540016bcd0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504723c8d 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:06.120571 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321802496}
I20260503 07:58:06.136225 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.136591 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.137857 28032 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:06.139374 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:06.141680 29974 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:06.144096 29971 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:06.153621 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.154230 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.156378 28029 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:06.159521 29716 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:06.160017 29716 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:06.162719 28032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:06.163223 28032 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:06.163542 28032 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.165375 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.134732 29965 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260503 07:58:06.173635 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.175557 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:06.176368 28617 raft_consensus.cc:2410] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260503 07:58:06.177225 27955 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:06.179392 28032 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.181375 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.182183 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.183251 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.183867 28105 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:06.183959 28032 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.174490 29716 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:06.191910 27926 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:06.192653 27926 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.195109 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.200443 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.194990 29695 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:06.207072 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.196581 29815 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:06.208060 29482 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:06.220003 28073 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.222766 29863 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:06.201156 29844 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260503 07:58:06.206810 29968 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:06.234959 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.232599 29893 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260503 07:58:06.234627 29874 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260503 07:58:06.231487 28073 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.208323 29695 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:06.243741 27924 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.252895 29909 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:06.253575 29882 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:06.254380 27924 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.255340 29909 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:06.255647 29909 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:06.245882 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.255959 29909 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:06.246127 27956 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:06.236030 28617 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260503 07:58:06.258111 28617 pending_rounds.cc:85] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Aborting all ops after (but not including) 4
I20260503 07:58:06.258337 28617 pending_rounds.cc:107] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260503 07:58:06.259780 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:06.267820 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:06.263571 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:06.272029 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:06.298115 28619 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:58:06.301116 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:06.264281 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:06.301668 28102 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.234403 29888 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260503 07:58:06.302759 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.259008 29695 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.301651 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:06.310218 28102 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
W20260503 07:58:06.310727 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 45022.5us
I20260503 07:58:06.258570 28617 raft_consensus.cc:2889] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:06.323681 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:06.328114 27957 raft_consensus.cc:3055] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:06.328387 27957 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:06.328851 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 56909.9us
I20260503 07:58:06.329044 27957 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.329833 29944 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:06.329910 27957 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.330690 29944 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:06.331266 29944 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:06.333729 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.335090 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.335968 29965 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:06.337762 27957 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:06.263863 28033 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:58:06.262933 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.302446 28029 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.343878 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:06.234577 29971 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:06.356537 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53082 (request call id 99) took 1456 ms. Trace:
I20260503 07:58:06.310169 29790 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:06.358390 27855 rpcz_store.cc:276] 0503 07:58:04.900470 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:04.900613 (+ 143us) service_pool.cc:224] Handling call
0503 07:58:06.356486 (+1455873us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50263,"reported_tablets":2}
I20260503 07:58:06.368611 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.371210 28109 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:06.400527 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.403442 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.404748 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.406642 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.409426 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.375157 29889 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:06.367396 29790 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:06.381290 29721 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:06.422637 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.424746 27924 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.430522 28029 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:06.374886 29802 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:06.431097 27924 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.434178 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.435130 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.435724 28109 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:06.436616 27924 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.437371 29783 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:06.410588 29863 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260503 07:58:06.441093 29802 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.442498 29878 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:06.443002 29878 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:06.445053 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.445243 29920 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:06.406384 29936 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260503 07:58:06.431021 29790 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:06.446415 29909 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.435803 29889 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:06.467797 29889 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.433940 29968 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260503 07:58:06.445089 29802 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.448712 29971 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260503 07:58:06.489387 27959 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.496414 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.507102 27959 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:06.490108 29902 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:06.495388 29802 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:06.528270 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:06.530218 28585 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.553004 29806 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:06.553597 29806 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:06.556172 29806 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:06.523818 29695 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.533219 29802 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.556998 29909 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.559177 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.592760 28104 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
W20260503 07:58:06.561434 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 99272us
I20260503 07:58:06.594285 28075 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:06.596694 29697 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
W20260503 07:58:06.561854 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 97273.4us
I20260503 07:58:06.597093 29697 raft_consensus.cc:697] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:06.598966 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 68863.6us
I20260503 07:58:06.493460 29944 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.569972 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:06.599010 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 61421.9us
I20260503 07:58:06.576109 28107 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
W20260503 07:58:06.560603 29984 log.cc:927] Time spent T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.066s user 0.001s sys 0.000s
I20260503 07:58:06.602666 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:06.617161 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:06.617537 28035 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:06.611445 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.619670 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
W20260503 07:58:06.560731 29979 log.cc:927] Time spent T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
I20260503 07:58:06.598083 29697 consensus_queue.cc:237] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:06.622833 28026 raft_consensus.cc:2368] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:06.624807 28073 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.591593 29802 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.626260 28034 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:06.563925 29814 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:06.626905 29814 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:06.625074 29828 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:06.631412 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:06.632637 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:06.562475 29695 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.634183 29944 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.566655 29878 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:06.637796 29955 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:06.638198 29955 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:06.638574 29955 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:06.642802 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.640664 28035 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:06.653925 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.659646 27924 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.662045 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:06.751857 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:06.628847 29814 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:06.781870 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:58:06.749627 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 89829.5us
I20260503 07:58:06.776314 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:06.796696 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 152080us
I20260503 07:58:06.797557 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:06.805717 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:06.811827 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:06.747458 29695 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:06.749241 29810 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:06.829596 27926 leader_election.cc:400] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:06.773178 29843 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:06.833691 27926 leader_election.cc:403] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260503 07:58:06.839090 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 55911.8us
W20260503 07:58:06.891966 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 63496.4us
I20260503 07:58:06.892782 27926 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:06.893347 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 65356.5us
W20260503 07:58:06.955912 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 61992.9us
W20260503 07:58:06.956039 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 61823.7us
I20260503 07:58:06.838953 29883 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6.
I20260503 07:58:06.841329 29843 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:06.897601 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:06.959882 29882 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
W20260503 07:58:06.963163 29977 log.cc:927] Time spent T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.131s user 0.000s sys 0.000s
I20260503 07:58:06.978142 27955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:06.978737 27955 raft_consensus.cc:606] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:06.974882 29863 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:06.971870 29843 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:06.974610 29895 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260503 07:58:07.032347 29990 log.cc:927] Time spent T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.478s user 0.007s sys 0.006s
W20260503 07:58:07.036702 29994 log.cc:927] Time spent T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
W20260503 07:58:07.037703 29992 log.cc:927] Time spent T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.077s user 0.000s sys 0.000s
I20260503 07:58:07.052248 29863 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:07.005985 29790 consensus_meta.cc:287] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.529s user 0.008s sys 0.000s
I20260503 07:58:06.979514 29844 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260503 07:58:07.052824 29863 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:07.100227 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:07.078529 27857 catalog_manager.cc:5671] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:07.107151 27857 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 6 to 7, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 7 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:07.010032 29882 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:07.119807 29920 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
W20260503 07:58:07.121479 29985 log.cc:927] Time spent T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260503 07:58:07.099220 29790 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.116024 27857 catalog_manager.cc:5671] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:07.148485 27857 catalog_manager.cc:5671] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:07.150552 27857 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:07.164042 27857 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2), pending config changed. New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.175343 28108 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
W20260503 07:58:07.174888 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 215562us
I20260503 07:58:07.141003 29920 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:07.178231 27857 catalog_manager.cc:5671] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:07.179759 27857 catalog_manager.cc:5671] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:07.190476 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:07.191009 28102 raft_consensus.cc:606] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:07.182060 29905 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:07.193787 29882 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:07.229351 29955 consensus_meta.cc:287] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.590s user 0.011s sys 0.000s
I20260503 07:58:07.229756 29955 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:07.231518 29955 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:07.243923 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:07.246254 29955 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.254849 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:07.255759 29959 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:07.257890 29888 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:07.259047 29843 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:07.283619 29843 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:07.284180 30007 log.cc:927] Time spent T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260503 07:58:07.284430 27954 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:07.238548 29920 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.285828 29920 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:07.288179 29895 consensus_queue.cc:1059] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:07.289088 29895 raft_consensus.cc:3055] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:07.289384 29895 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:07.289580 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:07.290145 29895 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:07.291481 29895 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:07.295545 30008 log.cc:927] Time spent T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.097s user 0.000s sys 0.001s
W20260503 07:58:07.301769 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 48695.3us
I20260503 07:58:07.272500 29863 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.306704 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:07.313759 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:07.337324 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:07.311692 29790 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:07.341531 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:07.351150 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:07.352062 28109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:07.352432 28109 raft_consensus.cc:606] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:07.352618 28109 raft_consensus.cc:614] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:07.354817 28034 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:07.354876 28622 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.372992 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:07.373659 28026 raft_consensus.cc:2368] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6.
I20260503 07:58:07.338362 29842 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:07.375638 29842 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.354035 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:07.378947 29817 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:07.379050 27954 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260503 07:58:07.353632 30007 log.cc:927] Time spent T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.069s user 0.002s sys 0.000s
I20260503 07:58:07.383658 28109 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:07.387912 29843 raft_consensus.cc:993] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:07.393078 29843 raft_consensus.cc:1081] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:07.417868 29863 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:07.418823 29842 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:07.420506 28617 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:07.433768 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:07.434720 29721 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:07.435195 29721 raft_consensus.cc:697] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:07.447446 27954 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.452020 28075 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:07.449514 29968 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.455111 29697 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:07.456067 30013 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:07.463390 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:07.465055 28109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:07.465588 28109 raft_consensus.cc:606] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:07.466795 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:07.466970 28026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:07.467440 28026 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:07.467772 28026 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:07.469677 29721 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:07.471131 29955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43212 (request call id 488) took 2140 ms. Trace:
I20260503 07:58:07.471567 29955 rpcz_store.cc:276] 0503 07:58:05.330671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:05.330805 (+ 134us) service_pool.cc:224] Handling call
0503 07:58:05.885668 (+554863us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b580020c0d0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850468048a 00007f8504702827 00007f850471faea 00007f8504720b4a 00007f850471fcfb 00007f850472b41c 00007f850472aa93 00007f8504722dda 00007f85096f8b89 00007f8502c67db4
0503 07:58:05.898396 (+ 12728us) log.cc:844] Serialized 487 byte log entry
0503 07:58:06.117649 (+219253us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400085fa0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850469d522 00007f850467e28a 00007f8504685133 00007f85046850b9 00007f8504685049 00007f8504685011 00007f85046841dd 0000000000379254 0000000000379099 00007f8501686ab5
0503 07:58:06.123314 (+ 5665us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b5400085fa0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85046a4f06 00007f850469e87a 00007f850469daf4 00007f850467e28a 00007f8504685133 00007f85046850b9 00007f8504685049 00007f8504685011 00007f85046841dd 0000000000379254
0503 07:58:07.471055 (+1347741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5775,"raft.queue_time_us":31473,"raft.run_cpu_time_us":6754,"raft.run_wall_time_us":399394,"spinlock_wait_cycles":289398016}
I20260503 07:58:07.473235 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 9376e27fcb734be296a0612be76962b1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 4)
I20260503 07:58:07.474565 28109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9376e27fcb734be296a0612be76962b1"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:07.476078 28109 raft_consensus.cc:606] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:07.477748 28028 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:07.482725 28075 leader_election.cc:400] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6.
I20260503 07:58:07.483049 28075 leader_election.cc:403] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260503 07:58:07.476317 28026 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.490420 28026 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:07.491998 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:07.492108 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:07.494349 27926 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:07.485692 29936 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:07.495623 29695 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:07.486416 28106 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.508080 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:07.509789 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:07.514569 28622 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.520844 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:07.508380 29863 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260503 07:58:07.548686 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:07.549232 28108 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:07.550057 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:07.562799 29955 raft_consensus.cc:993] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:07.563265 29955 raft_consensus.cc:1081] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:07.573561 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:07.587452 27955 raft_consensus.cc:3055] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:07.587709 27955 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:07.542932 29933 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260503 07:58:07.592715 28108 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:07.588294 27955 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.594252 27955 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:07.566792 29695 consensus_queue.cc:1059] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260503 07:58:07.596702 29695 raft_consensus.cc:3055] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:07.597149 29695 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:07.568696 29806 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:07.605684 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:07.606398 29965 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:07.606854 29965 raft_consensus.cc:697] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:07.607612 29965 consensus_queue.cc:237] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.615139 28028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:07.615665 28028 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:07.616075 28028 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:07.624810 28028 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.629132 28028 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:07.626585 27955 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:07.634806 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:07.634995 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:07.635315 28108 raft_consensus.cc:3055] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:07.635408 27957 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:07.635602 28108 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:07.636214 28108 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.630584 28029 raft_consensus.cc:2955] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.639585 28108 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
W20260503 07:58:07.642736 30021 log.cc:927] Time spent T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260503 07:58:07.637584 30013 raft_consensus.cc:993] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:07.648099 30013 raft_consensus.cc:1081] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
W20260503 07:58:07.650333 30019 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.117s user 0.000s sys 0.001s
I20260503 07:58:07.600467 29695 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.656633 29695 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:07.658815 29936 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6.
I20260503 07:58:07.667514 28108 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:07.671558 27957 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:07.674281 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:07.674391 28030 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:07.678247 29806 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:07.678683 29806 raft_consensus.cc:697] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:07.678977 28030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9376e27fcb734be296a0612be76962b1"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:07.679482 29806 consensus_queue.cc:237] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.681332 29882 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:07.685266 29936 raft_consensus.cc:993] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:07.685680 29936 raft_consensus.cc:1081] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:07.698529 28030 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:07.699034 28030 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:07.698490 28028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:07.699606 28028 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:07.700388 28028 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:07.717077 28028 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.739549 28100 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:07.744038 28030 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:07.750865 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:07.751048 28028 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:07.751365 27957 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:07.748361 29716 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260503 07:58:07.758242 28030 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:07.762601 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:07.763070 28108 raft_consensus.cc:3055] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:07.763304 28108 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:07.763852 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:07.763936 28108 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:07.764524 28100 raft_consensus.cc:3055] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:07.764696 27957 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:07.765075 28108 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:07.764827 28100 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:07.766768 28100 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.768636 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:07.772423 28100 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:07.779019 28108 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:07.779951 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:07.780563 29889 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:07.771893 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:07.783035 29889 raft_consensus.cc:697] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:07.784075 29889 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:07.773540 29933 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:07.801535 29933 raft_consensus.cc:697] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:07.801887 28100 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:07.802414 29933 consensus_queue.cc:237] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:07.849658 27856 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1), VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2), VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3), VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.851433 27856 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 4 to 6, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:07.871807 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 257) took 1727 ms. Trace:
I20260503 07:58:07.872146 27857 rpcz_store.cc:276] 0503 07:58:06.144020 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:06.144624 (+ 604us) service_pool.cc:224] Handling call
0503 07:58:07.871747 (+1727123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:07.429457 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:07.431772 (+ 2315us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:07.431805 (+ 33us) write_op.cc:435] Acquired schema lock
0503 07:58:07.431897 (+ 92us) tablet.cc:662] Decoding operations
0503 07:58:07.432734 (+ 837us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:07.432817 (+ 83us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:07.432851 (+ 34us) tablet.cc:685] Acquiring locks for 8 operations
0503 07:58:07.434845 (+ 1994us) tablet.cc:701] Row locks acquired
0503 07:58:07.434868 (+ 23us) write_op.cc:260] PREPARE: finished
0503 07:58:07.434993 (+ 125us) write_op.cc:270] Start()
0503 07:58:07.435090 (+ 97us) write_op.cc:276] Timestamp: P: 1777795087434950 usec, L: 0
0503 07:58:07.435120 (+ 30us) op_driver.cc:348] REPLICATION: starting
0503 07:58:07.439877 (+ 4757us) log.cc:844] Serialized 3505 byte log entry
0503 07:58:07.750140 (+310263us) op_driver.cc:464] REPLICATION: finished
0503 07:58:07.826008 (+ 75868us) write_op.cc:301] APPLY: starting
0503 07:58:07.826084 (+ 76us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:07.826334 (+ 250us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:07.826441 (+ 107us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:07.827351 (+ 910us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:07.827586 (+ 235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0503 07:58:07.827651 (+ 65us) write_op.cc:312] APPLY: finished
0503 07:58:07.828046 (+ 395us) log.cc:844] Serialized 65 byte log entry
0503 07:58:07.828215 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:07.828326 (+ 111us) write_op.cc:454] Released schema lock
0503 07:58:07.828370 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:07.828718 (+ 348us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:07.828751 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1744,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":72352,"apply.run_cpu_time_us":2654,"apply.run_wall_time_us":5988,"num_ops":8,"prepare.queue_time_us":184668,"prepare.run_cpu_time_us":26696,"prepare.run_wall_time_us":85964,"raft.queue_time_us":98687,"raft.run_cpu_time_us":16414,"raft.run_wall_time_us":51863,"replication_time_us":314878,"thread_start_us":314714,"threads_started":4,"wal-append.queue_time_us":93147}]]}
I20260503 07:58:07.901957 27943 tablet_service.cc:1558] Processing DeleteTablet for tablet 9376e27fcb734be296a0612be76962b1 with delete_type TABLET_DATA_TOMBSTONED (TS 37e72845941344c9b0aaa7235a6f4473 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45162
I20260503 07:58:07.903713 28617 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:07.905293 29716 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:07.908012 28100 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:07.909327 29842 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:07.916078 27854 catalog_manager.cc:5671] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:07.953322 27854 catalog_manager.cc:5671] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:07.997392 30035 tablet_replica.cc:333] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: stopping tablet replica
I20260503 07:58:07.998306 30035 raft_consensus.cc:2243] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260503 07:58:07.998831 30035 raft_consensus.cc:2272] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260503 07:58:08.011502 27856 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 3 to 4, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:08.023615 30035 ts_tablet_manager.cc:1916] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:08.090813 27857 catalog_manager.cc:5671] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:08.095147 27857 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:08.107820 27857 catalog_manager.cc:5671] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:08.111548 27857 catalog_manager.cc:5671] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 2 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 3 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:08.114441 27857 catalog_manager.cc:5671] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:08.115825 27857 catalog_manager.cc:5671] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:08.128330 30035 ts_tablet_manager.cc:1929] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260503 07:58:08.128758 30035 log.cc:1199] T 9376e27fcb734be296a0612be76962b1 P 37e72845941344c9b0aaa7235a6f4473: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/wals/9376e27fcb734be296a0612be76962b1
I20260503 07:58:08.130378 27842 catalog_manager.cc:5002] TS 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): tablet 9376e27fcb734be296a0612be76962b1 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:58:08.141202 27957 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:58:08.142467 29944 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:08.160899 28106 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:08.163579 29944 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:08.215063 28100 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:58:08.232932 27959 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:08.233989 29944 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:08.242795 29889 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:08.246002 28029 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:08.251583 28102 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:08.253746 29905 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:08.254993 28617 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:08.259693 29965 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260503 07:58:08.263688 30039 log.cc:927] Time spent T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260503 07:58:08.281373 27954 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:08.295876 29905 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:08.303820 29806 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:08.307914 28622 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:08.322149 28622 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:08.315606 27957 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:08.335058 28622 raft_consensus.cc:2955] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:08.358201 27856 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:08.371187 29933 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:08.374378 27844 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 7bd4f1f94ce446d19045339767e2f84a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:58:08.376811 27959 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:08.387123 28102 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:08.395130 28098 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bd4f1f94ce446d19045339767e2f84a with delete_type TABLET_DATA_TOMBSTONED (TS be26cebb7c90445ea9a74f66463457c1 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43212
I20260503 07:58:08.395022 29965 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:08.412271 29944 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:08.422511 30044 tablet_replica.cc:333] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: stopping tablet replica
I20260503 07:58:08.423424 30044 raft_consensus.cc:2243] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:58:08.424669 30044 raft_consensus.cc:2272] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260503 07:58:08.431308 30044 ts_tablet_manager.cc:1916] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:08.505781 30044 ts_tablet_manager.cc:1929] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260503 07:58:08.506313 30044 log.cc:1199] T 7bd4f1f94ce446d19045339767e2f84a P be26cebb7c90445ea9a74f66463457c1: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/wals/7bd4f1f94ce446d19045339767e2f84a
I20260503 07:58:08.555563 27842 catalog_manager.cc:5002] TS be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): tablet 7bd4f1f94ce446d19045339767e2f84a (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:58:08.589465 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260503 07:58:08.690878 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 45475.2us
I20260503 07:58:08.791159 29697 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:08.792116 29697 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:08.794776 29697 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:08.796841 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:08.798185 27957 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:08.803045 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:08.806916 29697 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:08.807319 29697 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:08.807653 29697 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:08.814446 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:08.815567 28029 raft_consensus.cc:2393] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:08.862490 30050 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:08.863183 30050 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:08.867182 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:08.868973 30050 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:08.903628 29697 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:08.911725 29938 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:08.912424 29938 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:08.914884 29938 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:08.915966 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:08.916580 27959 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:08.917610 28073 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:08.918329 29912 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:08.918669 29912 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:08.919013 29912 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:08.923677 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:08.930248 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:08.930323 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:08.931174 28029 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:08.929745 29697 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:08.938220 27959 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:08.939424 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:08.940173 29697 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:08.945458 27926 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:08.946532 30050 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:08.926710 29912 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:08.951661 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:08.960265 27957 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:08.961162 28073 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:08.963195 29938 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:08.963667 29938 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:08.965664 29938 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:08.967202 29912 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:08.973526 28034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:08.976938 28034 raft_consensus.cc:606] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:08.941625 29697 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:08.979499 29697 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:08.984764 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:08.996309 28029 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:08.982190 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:08.997269 28034 raft_consensus.cc:2393] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
W20260503 07:58:08.985737 27905 auto_rebalancer.cc:285] failed to send replica move request: Illegal state: Replica 37e72845941344c9b0aaa7235a6f4473 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:08.986351 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:08.999044 28030 raft_consensus.cc:606] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:09.001638 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:09.002231 28030 raft_consensus.cc:606] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:09.005039 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:09.005518 28030 raft_consensus.cc:606] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:09.008320 28106 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:09.008862 28106 raft_consensus.cc:606] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:09.011459 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:09.012032 28030 raft_consensus.cc:606] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:09.013335 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260503 07:58:09.015180 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:09.016103 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260503 07:58:09.019423 27905 auto_rebalancer.cc:806] Removing replace marker failed: Replica 37e72845941344c9b0aaa7235a6f4473 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
W20260503 07:58:09.019862 27905 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 3b30e1a1065f4cd298949319438c2dae, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:09.020205 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 3b30e1a1065f4cd298949319438c2dae, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.034714 27954 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.063491 29944 raft_consensus.cc:993] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.064190 29933 raft_consensus.cc:1081] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.066000 28106 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260503 07:58:09.067631 30050 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:09.073484 30042 raft_consensus.cc:993] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:09.073922 30042 raft_consensus.cc:1081] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Signalling peer be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:09.074870 28034 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260503 07:58:09.076144 28102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:43222
I20260503 07:58:09.076668 28102 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:09.076974 28102 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:09.084839 27854 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 7, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:09.086841 27954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:09.087502 27954 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:09.087761 27954 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.089968 29695 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:09.095548 28102 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.097867 28102 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:09.099337 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:09.100186 27957 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:09.102869 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:09.103542 28030 raft_consensus.cc:3055] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:09.103864 28030 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.114238 28030 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.115185 28030 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:09.117233 29905 consensus_queue.cc:1175] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "37e72845941344c9b0aaa7235a6f4473" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260503 07:58:09.121883 27957 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:09.124707 28073 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:09.125469 29912 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:09.125962 29912 raft_consensus.cc:697] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:09.126842 29912 consensus_queue.cc:237] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.135430 28030 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:09.155834 27954 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.168603 29790 raft_consensus.cc:993] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:09.187320 29790 raft_consensus.cc:1081] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:09.173136 30049 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:09.188720 28034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:09.189273 28034 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:09.189615 28034 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.177459 28029 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:09.196594 28034 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.199100 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:09.199673 27957 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.175109 28100 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:09.211711 27957 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:09.213110 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:09.213917 30042 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:09.214380 30042 raft_consensus.cc:697] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.215178 30042 consensus_queue.cc:237] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.218648 28034 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.220031 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:09.220841 28102 raft_consensus.cc:3055] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
W20260503 07:58:09.228093 27905 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 77488bc798a841d697b108fb23d5531b, TS adaf84b6ac60420ab03d39b9db9f0413 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:09.228494 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 77488bc798a841d697b108fb23d5531b, TS adaf84b6ac60420ab03d39b9db9f0413 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.226854 28102 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:09.233927 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:09.234910 28034 raft_consensus.cc:3055] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:09.235210 28034 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.238301 27954 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.239045 28034 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.240556 28034 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.243925 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:09.246302 28106 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.245797 30042 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:09.247277 30042 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.249228 30042 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.250100 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:09.250609 28034 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:09.251093 27954 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:09.235704 28102 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.251470 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:09.252660 28102 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.253361 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:09.254766 29905 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:09.255260 29905 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:09.255687 29905 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.256317 27926 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:09.257308 29716 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:09.257922 29716 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:09.258812 28106 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:09.258850 29716 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.269280 28102 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:09.287395 29905 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.289300 29905 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.293771 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:09.294354 27957 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.297111 27856 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index -1 to 5. New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:09.305557 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:09.322813 29889 raft_consensus.cc:993] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.323204 30042 raft_consensus.cc:1081] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.330364 27959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:09.330814 27959 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:09.331140 27959 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:09.335274 27957 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:09.337558 29905 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:09.338069 29905 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.338779 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:09.339982 29905 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.340571 30042 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:09.336364 27954 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.341095 30042 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.341997 30042 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.345999 27959 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.347436 27959 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.348351 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:09.348826 28102 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:09.349428 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:09.349956 28034 raft_consensus.cc:3055] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:09.350221 28034 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.348520 27854 catalog_manager.cc:5671] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:09.352065 28034 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.352916 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:09.353083 28034 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:09.357543 27854 catalog_manager.cc:5671] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:09.365651 28034 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:09.370863 28102 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:09.372048 27924 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:09.372838 29695 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:09.373291 29695 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:09.374013 29695 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.377177 27856 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 6, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:09.381982 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:09.382802 27959 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:09.384312 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:09.385892 29965 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:09.386312 29965 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:09.386674 29965 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:09.389110 29889 raft_consensus.cc:993] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.389550 29889 raft_consensus.cc:1081] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.391171 29933 raft_consensus.cc:993] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.391649 29933 raft_consensus.cc:1081] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:09.395888 28100 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:09.401201 29716 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:09.408197 27959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:09.409260 27957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:09.409888 27957 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:09.410233 27957 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.408761 27959 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:09.413365 27959 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:09.414211 27856 catalog_manager.cc:5671] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:09.415685 27856 catalog_manager.cc:5671] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:09.417093 29965 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.418941 27955 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:09.421736 29965 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.422569 29912 consensus_queue.cc:1059] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:09.423030 28030 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:09.423317 29790 raft_consensus.cc:3055] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:09.423664 29790 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:09.424474 28030 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:09.424320 29790 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.425321 29790 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.426414 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:09.426931 27955 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:09.428874 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:09.429352 27959 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.430379 30049 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:09.434089 27955 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:09.433456 27957 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.438169 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:09.438652 28102 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:09.438828 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:09.439380 28106 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.440940 27959 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.443953 28102 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:09.457732 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:09.459052 28030 raft_consensus.cc:3055] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:09.459343 28030 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.460098 28030 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.461419 28030 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:09.461215 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:09.462209 28034 raft_consensus.cc:3055] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:09.464272 28034 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.450736 28106 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:09.465914 28109 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:09.465826 28034 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.467401 27924 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:09.472322 27924 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:09.473093 29695 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:09.473502 29695 raft_consensus.cc:697] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:09.474579 29716 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:09.474313 29695 consensus_queue.cc:237] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.475029 29716 raft_consensus.cc:697] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:09.471736 28034 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:09.475868 29716 consensus_queue.cc:237] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.467885 27854 catalog_manager.cc:5671] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:09.458521 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:09.479316 30066 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:09.479861 30066 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:09.480679 30066 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.449266 27957 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:09.471036 28030 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:09.494910 30050 raft_consensus.cc:2955] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:09.504760 28109 raft_consensus.cc:2955] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
W20260503 07:58:09.509400 27905 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet c3757a05a49e489386cdbf85d2f8e970, TS adaf84b6ac60420ab03d39b9db9f0413 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:09.509793 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet c3757a05a49e489386cdbf85d2f8e970, TS adaf84b6ac60420ab03d39b9db9f0413 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:09.520491 27905 auto_rebalancer.cc:806] Removing replace marker failed: Leader has not yet committed an operation in its own term
W20260503 07:58:09.520803 27905 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 0bf3170afa5c43ddae7a0f830c5eb3dc, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:09.521356 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 0bf3170afa5c43ddae7a0f830c5eb3dc, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.523128 28034 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:09.531788 27854 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 7 to 8, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 8 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:09.544478 27954 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:09.546061 29912 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:09.546921 29912 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:09.547236 29912 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:09.548163 29912 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:09.549448 29912 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:09.549918 27856 catalog_manager.cc:5671] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 6, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:09.551417 27856 catalog_manager.cc:5671] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:09.577828 27856 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index -1 to 7. New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
W20260503 07:58:09.636685 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 77052us
W20260503 07:58:09.636099 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 56058us
I20260503 07:58:09.680648 28028 raft_consensus.cc:2955] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:09.689888 27959 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:09.691401 29697 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:09.713320 28028 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:09.717337 29697 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:09.760473 27955 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:09.766093 27955 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260503 07:58:09.835214 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 54053us
I20260503 07:58:09.835839 29806 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:09.848272 29889 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:09.849045 28109 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260503 07:58:09.849423 28109 pending_rounds.cc:85] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: Aborting all ops after (but not including) 3
I20260503 07:58:09.849663 28109 pending_rounds.cc:107] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260503 07:58:09.849913 28109 raft_consensus.cc:2889] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:09.863197 28100 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:09.872639 30050 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:09.876956 28030 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:09.880716 28029 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:09.887439 28029 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:09.894537 28109 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:09.895851 30050 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260503 07:58:09.928362 28100 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:09.934628 28100 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:09.956939 30049 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:09.959229 29695 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:09.960553 29716 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:09.974635 30083 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:09.991643 30042 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:10.004273 30066 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:10.006177 28029 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:10.033704 28109 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260503 07:58:10.034014 28109 pending_rounds.cc:85] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Aborting all ops after (but not including) 4
I20260503 07:58:10.034233 28109 pending_rounds.cc:107] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260503 07:58:10.034441 28109 raft_consensus.cc:2889] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:10.046948 29716 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:10.050156 28100 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:10.051728 30050 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:10.123353 29889 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:10.147845 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:10.176414 27955 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:10.190678 29889 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:10.239420 28100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:10.240142 28100 raft_consensus.cc:606] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:10.243350 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:10.243933 28030 raft_consensus.cc:606] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:10.246716 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9376e27fcb734be296a0612be76962b1"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "25017111886b42cfa5701a39de59b6ad"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:10.247231 28030 raft_consensus.cc:606] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Received request to transfer leadership to TS 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:10.251986 28034 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:10.252451 28034 raft_consensus.cc:606] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:10.253615 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260503 07:58:10.255115 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:10.255726 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:10.264694 29806 raft_consensus.cc:993] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 25017111886b42cfa5701a39de59b6ad to start an election
I20260503 07:58:10.265132 29806 raft_consensus.cc:1081] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Signalling peer 25017111886b42cfa5701a39de59b6ad to start an election
I20260503 07:58:10.285287 28622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9376e27fcb734be296a0612be76962b1"
dest_uuid: "25017111886b42cfa5701a39de59b6ad"
from {username='slave'} at 127.0.0.1:51178
I20260503 07:58:10.285885 28622 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:10.286239 28622 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:10.318498 28622 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:10.346182 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:10.346998 28034 raft_consensus.cc:3055] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:10.350633 28034 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:10.351517 28034 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:10.352666 28034 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:10.365669 28622 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:10.366813 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:10.367404 28102 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:10.376148 28102 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:10.383950 28034 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:10.385210 28585 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:10.386117 30073 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:10.386588 30073 raft_consensus.cc:697] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:10.387475 30073 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:10.418164 27857 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 7 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:10.563313 29965 raft_consensus.cc:993] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:10.563769 29889 raft_consensus.cc:1081] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:10.566908 27955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:10.567409 27955 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:10.567713 27955 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:10.586014 27955 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:10.594449 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:10.594923 28029 raft_consensus.cc:3055] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:10.595177 28029 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:10.595816 28029 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:10.596771 28029 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:10.597951 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:10.600054 28102 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:10.605427 29697 raft_consensus.cc:993] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:10.605901 29697 raft_consensus.cc:1081] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:10.607901 28030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:10.608389 28030 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:10.608709 28030 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:10.610651 28102 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:10.615113 27924 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:10.616698 30083 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:10.617233 30083 raft_consensus.cc:697] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:10.618187 30083 consensus_queue.cc:237] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:10.619179 27955 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:10.617722 28029 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:10.614907 28030 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:10.646790 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:10.647446 28102 raft_consensus.cc:3055] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:10.647792 28102 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:10.648666 27856 catalog_manager.cc:5671] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:10.653414 28102 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:10.654531 28102 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:10.658489 28030 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:10.660086 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:10.660574 28622 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:10.671541 28622 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:10.672292 28102 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:10.674453 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:10.681515 29889 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:10.681975 29889 raft_consensus.cc:697] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:10.682839 29889 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:10.688213 27955 consensus_queue.cc:237] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:10.708012 28102 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:58:10.710382 29716 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260503 07:58:10.717275 27924 consensus_peers.cc:597] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd5660140f2a4a67bee640fa37b03a74. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:58:10.722069 27856 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:10.729466 28030 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:58:10.736459 30050 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:10.738857 29965 raft_consensus.cc:993] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:10.739347 29965 raft_consensus.cc:1081] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:10.743489 27955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:10.744156 27955 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:10.744587 27955 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:10.760382 27955 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:10.762454 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:10.762949 28029 raft_consensus.cc:3055] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:10.763335 28029 raft_consensus.cc:740] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:10.763864 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:10.764417 28102 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:10.766458 28029 consensus_queue.cc:260] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:10.767620 28029 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:10.772646 28102 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:10.774585 27924 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:10.776029 29716 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:10.776481 29716 raft_consensus.cc:697] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:10.776746 30083 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:10.777474 29716 consensus_queue.cc:237] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:10.804371 28034 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260503 07:58:10.806090 30073 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260503 07:58:10.808027 27856 catalog_manager.cc:5671] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 3, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:10.810791 28102 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:10.831162 28029 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:10.835737 28109 consensus_queue.cc:237] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:10.762907 27955 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:10.855057 28109 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260503 07:58:10.856770 30073 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260503 07:58:10.857843 28028 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:58:10.860394 28029 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
W20260503 07:58:10.864848 28073 consensus_peers.cc:597] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 904abdfb5f89462c8a674a30012ffef3. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:58:10.881753 29938 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:58:10.874594 27856 catalog_manager.cc:5671] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index -1 to 3, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:10.889585 27955 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260503 07:58:10.895399 29697 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260503 07:58:10.974608 29697 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.021682 27857 catalog_manager.cc:5671] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:11.022545 27959 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:11.015894 27955 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.043748 28029 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:11.045848 29716 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:11.050155 28102 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:11.050925 28030 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:11.052631 30083 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260503 07:58:11.054551 27924 consensus_peers.cc:597] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77488bc798a841d697b108fb23d5531b. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:58:11.056247 28030 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.057255 30083 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:11.089962 28100 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:11.091401 29716 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:11.098292 30049 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.111105 28100 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.119452 28034 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.122304 28622 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260503 07:58:11.123621 29889 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:11.139848 28106 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:11.150825 27857 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 5 to 6, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:11.189705 28109 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260503 07:58:11.195533 29965 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260503 07:58:11.220158 27959 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:11.222112 30109 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260503 07:58:11.238458 28073 consensus_peers.cc:597] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 -> Peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367): Couldn't send request to peer 25017111886b42cfa5701a39de59b6ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eec1cba8286a4c81a9f66d33c805d337. This is attempt 1: this message will repeat every 5th retry.
I20260503 07:58:11.252141 28034 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:11.259485 30125 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:11.288079 27959 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.285374 30114 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.337494 27857 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index -1 to 5, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:11.353403 30130 ts_tablet_manager.cc:933] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:11.358652 28029 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:58:11.361543 28102 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260503 07:58:11.383893 30126 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:11.373920 30131 ts_tablet_manager.cc:933] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:11.396071 30126 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:11.417384 30131 tablet_copy_client.cc:323] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.1:34525
I20260503 07:58:11.437160 27970 tablet_copy_service.cc:140] P 37e72845941344c9b0aaa7235a6f4473: Received BeginTabletCopySession request for tablet fd5660140f2a4a67bee640fa37b03a74 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:41856)
I20260503 07:58:11.437711 27970 tablet_copy_service.cc:161] P 37e72845941344c9b0aaa7235a6f4473: Beginning new tablet copy session on tablet fd5660140f2a4a67bee640fa37b03a74 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:41856: session id = 25017111886b42cfa5701a39de59b6ad-fd5660140f2a4a67bee640fa37b03a74
I20260503 07:58:11.446448 30130 tablet_copy_client.cc:323] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:58:11.448208 28118 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet 904abdfb5f89462c8a674a30012ffef3 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:58:11.448737 28118 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet 904abdfb5f89462c8a674a30012ffef3 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-904abdfb5f89462c8a674a30012ffef3
I20260503 07:58:11.453838 27970 tablet_copy_source_session.cc:215] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:58:11.462823 30131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5660140f2a4a67bee640fa37b03a74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:58:11.483989 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:11.500295 28034 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 25017111886b42cfa5701a39de59b6ad (127.26.42.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } } }
I20260503 07:58:11.456581 28118 tablet_copy_source_session.cc:215] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:58:11.518590 30130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904abdfb5f89462c8a674a30012ffef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:58:11.530442 30131 tablet_copy_client.cc:806] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:58:11.557332 30131 tablet_copy_client.cc:670] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:58:11.565825 30130 tablet_copy_client.cc:806] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:58:11.566588 30130 tablet_copy_client.cc:670] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:58:11.567234 30131 tablet_copy_client.cc:538] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:58:11.584709 30131 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:58:11.602486 30130 tablet_copy_client.cc:538] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:58:11.615300 30130 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:58:11.663421 30138 ts_tablet_manager.cc:933] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:11.736379 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:11.713243 30138 tablet_copy_client.cc:323] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.1:34525
I20260503 07:58:11.736940 28102 raft_consensus.cc:606] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:11.748814 27955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:11.749357 27955 raft_consensus.cc:606] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:11.759230 27970 tablet_copy_service.cc:140] P 37e72845941344c9b0aaa7235a6f4473: Received BeginTabletCopySession request for tablet 77488bc798a841d697b108fb23d5531b from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:41856)
I20260503 07:58:11.759634 27970 tablet_copy_service.cc:161] P 37e72845941344c9b0aaa7235a6f4473: Beginning new tablet copy session on tablet 77488bc798a841d697b108fb23d5531b from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:41856: session id = 25017111886b42cfa5701a39de59b6ad-77488bc798a841d697b108fb23d5531b
I20260503 07:58:11.760097 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:11.760648 28030 raft_consensus.cc:606] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:11.771106 27970 tablet_copy_source_session.cc:215] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:58:11.774341 30138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77488bc798a841d697b108fb23d5531b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:58:11.779418 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260503 07:58:11.781092 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:11.782977 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:11.800419 30131 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:58:11.808210 30138 tablet_copy_client.cc:806] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:58:11.808796 30138 tablet_copy_client.cc:670] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:58:11.810725 30141 ts_tablet_manager.cc:933] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Initiating tablet copy from peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:11.816824 30131 tablet_bootstrap.cc:492] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:58:11.817687 30131 ts_tablet_manager.cc:1403] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.233s user 0.023s sys 0.007s
I20260503 07:58:11.824330 30138 tablet_copy_client.cc:538] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:58:11.825629 30130 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:58:11.828787 30141 tablet_copy_client.cc:323] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Beginning tablet copy session from remote peer at address 127.26.42.3:45643
I20260503 07:58:11.846757 30131 raft_consensus.cc:359] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:11.861464 28118 tablet_copy_service.cc:140] P be26cebb7c90445ea9a74f66463457c1: Received BeginTabletCopySession request for tablet eec1cba8286a4c81a9f66d33c805d337 from peer 25017111886b42cfa5701a39de59b6ad ({username='slave'} at 127.0.0.1:59398)
I20260503 07:58:11.861941 30130 tablet_bootstrap.cc:492] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:58:11.862021 28118 tablet_copy_service.cc:161] P be26cebb7c90445ea9a74f66463457c1: Beginning new tablet copy session on tablet eec1cba8286a4c81a9f66d33c805d337 from peer 25017111886b42cfa5701a39de59b6ad at {username='slave'} at 127.0.0.1:59398: session id = 25017111886b42cfa5701a39de59b6ad-eec1cba8286a4c81a9f66d33c805d337
I20260503 07:58:11.862744 30130 ts_tablet_manager.cc:1403] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.248s user 0.019s sys 0.022s
I20260503 07:58:11.866839 30130 raft_consensus.cc:359] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:11.867705 30130 raft_consensus.cc:740] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:58:11.853466 30131 raft_consensus.cc:740] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:58:11.872627 30130 consensus_queue.cc:260] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:11.873884 30131 consensus_queue.cc:260] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:11.876277 30131 ts_tablet_manager.cc:1434] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.049s user 0.004s sys 0.002s
I20260503 07:58:11.877470 29889 raft_consensus.cc:993] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:11.877763 27970 tablet_copy_service.cc:342] P 37e72845941344c9b0aaa7235a6f4473: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-fd5660140f2a4a67bee640fa37b03a74 received from {username='slave'} at 127.0.0.1:41856
I20260503 07:58:11.877866 29889 raft_consensus.cc:1081] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:11.878211 27970 tablet_copy_service.cc:434] P 37e72845941344c9b0aaa7235a6f4473: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-fd5660140f2a4a67bee640fa37b03a74 on tablet fd5660140f2a4a67bee640fa37b03a74 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:11.878984 30130 ts_tablet_manager.cc:1434] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.016s user 0.003s sys 0.003s
I20260503 07:58:11.880151 27959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:11.880939 27959 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:11.881240 27959 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:11.895097 28119 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-904abdfb5f89462c8a674a30012ffef3 received from {username='slave'} at 127.0.0.1:59398
I20260503 07:58:11.895502 28119 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-904abdfb5f89462c8a674a30012ffef3 on tablet 904abdfb5f89462c8a674a30012ffef3 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:11.898120 27959 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:11.900071 30138 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:58:11.901569 27959 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:11.902014 28118 tablet_copy_source_session.cc:215] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1: Tablet Copy: opened 0 blocks and 1 log segments
I20260503 07:58:11.902355 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:11.906071 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:11.906826 28109 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:11.906893 28030 raft_consensus.cc:3055] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:11.907342 28030 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:11.908015 28030 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:11.909518 28030 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:11.911123 30141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eec1cba8286a4c81a9f66d33c805d337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260503 07:58:11.919556 28030 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:11.929769 28109 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:11.937047 27924 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:11.937862 29716 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:11.938297 29716 raft_consensus.cc:697] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:11.939015 29716 consensus_queue.cc:237] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:11.967526 29716 raft_consensus.cc:993] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:11.967937 29716 raft_consensus.cc:1081] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Signalling peer be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:11.972354 28102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:43228
I20260503 07:58:11.972015 27857 catalog_manager.cc:5671] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:11.972860 28102 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:11.973385 28102 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:11.978554 30141 tablet_copy_client.cc:806] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 0 data blocks...
I20260503 07:58:11.979117 30141 tablet_copy_client.cc:670] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Starting download of 1 WAL segments...
I20260503 07:58:11.979368 28102 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:11.984120 28102 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:11.984416 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:11.985230 27959 raft_consensus.cc:3055] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:11.986083 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:11.986606 28030 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:11.988096 30141 tablet_copy_client.cc:538] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260503 07:58:11.985590 27959 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:11.996433 27959 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:11.998060 27959 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:11.998674 28030 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:12.004009 28075 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:12.004667 30109 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:12.005081 30109 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:12.005816 30109 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:12.014433 27959 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:12.037452 30141 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Bootstrap starting.
I20260503 07:58:12.060022 30138 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:58:12.066767 27856 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 7, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:12.076290 30138 tablet_bootstrap.cc:492] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:58:12.077584 30138 ts_tablet_manager.cc:1403] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.178s user 0.025s sys 0.007s
I20260503 07:58:12.087576 30138 raft_consensus.cc:359] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:12.091572 30138 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:58:12.092301 30138 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:12.095374 30138 ts_tablet_manager.cc:1434] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20260503 07:58:12.097173 27970 tablet_copy_service.cc:342] P 37e72845941344c9b0aaa7235a6f4473: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-77488bc798a841d697b108fb23d5531b received from {username='slave'} at 127.0.0.1:41856
I20260503 07:58:12.097548 27970 tablet_copy_service.cc:434] P 37e72845941344c9b0aaa7235a6f4473: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-77488bc798a841d697b108fb23d5531b on tablet 77488bc798a841d697b108fb23d5531b with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:12.117722 28619 raft_consensus.cc:1217] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260503 07:58:12.150676 28619 raft_consensus.cc:1217] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 LEARNER]: Deduplicated request from leader. Original: 4.5->[4.6-4.6] Dedup: 4.6->[]
I20260503 07:58:12.179358 30141 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260503 07:58:12.185734 30141 tablet_bootstrap.cc:492] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Bootstrap complete.
I20260503 07:58:12.186370 30141 ts_tablet_manager.cc:1403] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Time spent bootstrapping tablet: real 0.149s user 0.028s sys 0.012s
I20260503 07:58:12.189064 30141 raft_consensus.cc:359] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:12.189894 30141 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Initialized, Role: LEARNER
I20260503 07:58:12.196223 30141 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:12.197898 30058 raft_consensus.cc:993] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:12.198344 30058 raft_consensus.cc:1081] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:12.198655 30141 ts_tablet_manager.cc:1434] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260503 07:58:12.199820 28030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:12.200337 28030 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:12.200641 28030 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:12.209923 28118 tablet_copy_service.cc:342] P be26cebb7c90445ea9a74f66463457c1: Request end of tablet copy session 25017111886b42cfa5701a39de59b6ad-eec1cba8286a4c81a9f66d33c805d337 received from {username='slave'} at 127.0.0.1:59398
I20260503 07:58:12.210319 28118 tablet_copy_service.cc:434] P be26cebb7c90445ea9a74f66463457c1: ending tablet copy session 25017111886b42cfa5701a39de59b6ad-eec1cba8286a4c81a9f66d33c805d337 on tablet eec1cba8286a4c81a9f66d33c805d337 with peer 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:12.213269 28030 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:12.218573 28030 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:12.219210 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:12.220310 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:12.221634 28109 raft_consensus.cc:3055] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:12.221822 28109 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:12.223026 27959 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:12.228046 27959 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:12.229059 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:12.229844 30066 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:12.225212 28109 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:12.232291 30066 raft_consensus.cc:697] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:12.234863 30066 consensus_queue.cc:237] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:12.270613 28109 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:12.279970 28109 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:12.295903 28619 raft_consensus.cc:1217] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20260503 07:58:12.300074 27857 catalog_manager.cc:5671] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:12.331539 28619 raft_consensus.cc:1217] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5] Dedup: 6.5->[]
I20260503 07:58:12.427608 27954 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:12.428922 30109 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:12.442301 28029 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260503 07:58:12.445683 27842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 66530.7us
I20260503 07:58:12.446655 28109 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:12.450166 30123 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:12.456321 28029 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260503 07:58:12.470173 30123 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:12.490937 30114 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:12.651710 30058 raft_consensus.cc:1064] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:58:12.654717 30058 consensus_queue.cc:237] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:12.660189 27954 raft_consensus.cc:1275] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:12.663441 30111 consensus_queue.cc:1048] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260503 07:58:12.693326 28109 raft_consensus.cc:1275] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:12.699317 30066 consensus_queue.cc:1048] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:12.729640 28619 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:58:12.731503 28030 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:58:12.731386 30114 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:12.731978 27954 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260503 07:58:12.733790 30109 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:12.736174 30109 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:12.759917 30123 raft_consensus.cc:1064] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:58:12.762518 30123 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:12.793926 28109 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260503 07:58:12.796561 28622 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 LEARNER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260503 07:58:12.812058 30083 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260503 07:58:12.834395 30123 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:12.882370 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:12.889484 30124 raft_consensus.cc:1064] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:58:12.899837 30124 consensus_queue.cc:237] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:12.909114 30114 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:13.771008 30111 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:13.771781 30111 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:13.774382 30111 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:13.847702 30111 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:13.857460 30111 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:13.872289 30111 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:13.901670 30111 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:13.902338 30111 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:13.905607 30111 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.029116 30111 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:14.029827 30111 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.032271 30111 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.053404 30111 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.017791 30175 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.074950 30175 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.077358 30175 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.077980 30175 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.112802 30176 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.136345 30177 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.198709 30179 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.199357 30179 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.202380 30181 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:14.205168 30181 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.207613 30181 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.210359 30179 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.211323 30184 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.204495 30178 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.216483 30178 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.208370 30177 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.214056 30185 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.218516 30185 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:14.219483 30177 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.219952 30177 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.219957 30178 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.220419 30177 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.222168 30185 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.222774 30177 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.208778 30176 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.222783 30184 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.224506 30176 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.197484 30175 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.226891 30184 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.201570 30111 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.236692 30175 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:14.237854 27999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.381s user 0.003s sys 0.027s
I20260503 07:58:14.239418 30176 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:14.239604 30188 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:14.239914 27999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.383s user 0.003s sys 0.027s
W20260503 07:58:14.240319 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 1.3839e+06us
I20260503 07:58:14.239987 30176 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.244526 30176 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.245489 30176 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.245931 30176 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.244969 30177 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:14.249918 28622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.433s user 0.023s sys 0.007s
W20260503 07:58:14.254542 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 55845.2us
W20260503 07:58:14.254863 28622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.438s user 0.024s sys 0.007s
I20260503 07:58:14.231809 30181 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.251931 30111 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.240170 30188 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.259846 30188 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.256183 28622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51194 (request call id 245) took 1441 ms. Trace:
I20260503 07:58:14.233167 30179 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.256781 30181 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.262248 30190 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.261508 30177 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.262250 30180 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.272289 30189 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.274108 30111 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.278174 30193 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.264341 30176 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.290601 30176 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.295603 30176 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.297297 30176 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.298626 30177 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.269546 28622 rpcz_store.cc:276] 0503 07:58:12.814454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:12.814801 (+ 347us) service_pool.cc:224] Handling call
0503 07:58:12.815202 (+ 401us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:12.815483 (+ 281us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:12.815505 (+ 22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:12.816428 (+ 923us) log.cc:844] Serialized 548 byte log entry
0503 07:58:14.255454 (+1439026us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:14.255507 (+ 53us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:14.255590 (+ 83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:14.255641 (+ 51us) raft_consensus.cc:1685] finished
0503 07:58:14.255657 (+ 16us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:14.255795 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1438706,"threads_started":1,"wal-append.queue_time_us":255942,"wal-append.run_cpu_time_us":1801,"wal-append.run_wall_time_us":1026557}
I20260503 07:58:14.280682 30179 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.304232 30179 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.283090 30186 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.304919 30186 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.283397 30111 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.306748 30186 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.307410 30111 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.308100 30181 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.309618 30083 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:14.310132 30083 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.283514 30180 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.311972 30083 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.312255 30180 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.289322 30188 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.314303 30188 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.316414 30188 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.326179 30187 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.328619 30178 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.329690 30178 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:14.330542 30174 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.331135 30174 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.333770 30187 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.283852 30190 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.335546 30187 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.331591 30178 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.336396 30181 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:14.336791 30190 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.336944 30181 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.286818 30193 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:14.338780 30181 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.339231 30181 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.339617 30181 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.340088 30193 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.326257 30083 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.286091 30189 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.340802 30183 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.351966 30083 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.359444 30186 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.376641 30179 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.387637 30179 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.388005 30192 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.388625 30192 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.378769 30187 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.377799 30183 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.436084 30178 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:14.437541 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 79187.3us
I20260503 07:58:14.359267 30180 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.351313 30174 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.436723 30178 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.466075 30174 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.436120 30187 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.482056 30174 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:14.484014 30174 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:14.443276 30188 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.504469 30188 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.506669 30188 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.518783 30083 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.572504 30204 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.573124 30204 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.443437 30193 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.535521 30174 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.389688 30186 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.806915 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:14.820639 30188 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:14.785423 30179 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.825927 30174 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.481204 30180 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.578143 30083 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.575440 30202 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.575486 30204 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.839449 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:14.847522 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:14.856086 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:14.838125 30206 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.797408 30193 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.840461 30187 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.843930 30178 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.892824 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:14.846313 30181 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.897460 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:14.898097 28028 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:14.900992 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:14.860437 30204 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.858551 30083 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.848380 30188 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.895092 30187 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.922987 30197 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.922996 30187 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.926366 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:14.927104 28622 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 1.
I20260503 07:58:14.923601 30197 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.919245 30204 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:14.924973 30124 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.935128 30199 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.935492 30213 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.936185 30194 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.149374 30194 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.151607 30194 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:14.937153 30188 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.938336 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:14.938596 30193 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.941422 30208 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:14.941872 30212 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.153301 30208 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.153489 30212 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.155720 30208 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.156037 30212 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.942807 30180 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.943285 30174 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.943900 30203 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:14.854358 30202 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.944032 30186 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.158546 28102 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 1.
I20260503 07:58:14.889124 30206 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.156672 30212 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.947796 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:14.948906 28619 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:14.950963 30204 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:14.951535 30197 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.164685 30197 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.164748 30206 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.933893 30209 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.166651 30209 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.167869 30202 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:14.975356 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:14.983289 28026 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260503 07:58:14.974138 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:14.987443 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 75148us
I20260503 07:58:15.158602 30199 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:14.974128 30205 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.003124 30214 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.175630 30214 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.004202 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.004789 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.004875 30215 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.176772 28104 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:58:15.006544 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:14.985203 30207 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.007400 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.054659 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.180332 30214 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.062222 30224 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.176841 30189 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.181602 30219 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.181363 30224 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.182042 30219 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.183211 30224 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:15.068552 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 63253.8us
I20260503 07:58:15.183859 30219 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.166157 30126 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.184194 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:15.070606 30222 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:15.184541 30126 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.185163 30222 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.186480 30126 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.071848 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.072332 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.187139 30222 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.187173 28105 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:15.187604 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.165192 30197 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.187681 30207 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.188102 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.188817 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.189141 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.080024 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.189347 28108 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:15.189519 30197 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.082835 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.190276 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.190595 28106 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:15.191382 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.191869 28106 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:15.192507 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.084990 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:15.086830 30220 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.088121 30211 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:15.193285 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.193833 30199 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.193907 30211 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.194581 30227 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.193539 30186 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:15.195032 30227 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.195631 30186 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.196113 30186 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:15.113287 30216 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.116230 28033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:15.117987 30179 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.122032 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33434 (request call id 302) took 2223 ms. Trace:
I20260503 07:58:15.126806 30083 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.126451 27857 catalog_manager.cc:5671] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260503 07:58:15.193389 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 108467us
I20260503 07:58:15.196854 28033 raft_consensus.cc:606] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:15.195025 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.198648 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.126840 30183 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.145314 30213 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.161283 28109 raft_consensus.cc:2468] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:58:15.163368 30203 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.205124 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.164165 30210 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:14.971678 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:14.978456 30192 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.177750 28103 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:15.145349 30124 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.178810 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.180784 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.196149 30211 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.112383 30221 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.197474 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.117697 30223 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.223711 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.179013 30194 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.199149 28106 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:15.189152 30215 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.197100 30179 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.164073 30226 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.211004 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.211367 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.236546 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.209579 30209 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.212360 28101 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:15.239459 28108 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:15.215167 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.215579 28105 raft_consensus.cc:2410] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260503 07:58:15.217221 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:15.212574 30210 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:15.240989 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.241519 28108 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:15.222180 30083 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.242146 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.242308 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.242395 30083 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.243889 28583 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:15.244150 30083 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.242152 28108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:14.945580 30187 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.165480 30212 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.222664 30223 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.245491 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.246500 30212 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.246929 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.247156 30223 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.245000 28108 raft_consensus.cc:606] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:15.248601 30217 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:15.225847 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.199302 27855 rpcz_store.cc:276] 0503 07:58:12.898087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:14.336891 (+1438804us) service_pool.cc:224] Handling call
0503 07:58:15.121842 (+784951us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260503 07:58:15.250420 28583 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:15.219398 30227 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.226794 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.196765 30216 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.255414 30179 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.256006 30192 raft_consensus.cc:2804] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:15.256369 30192 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.256688 30216 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.235112 28618 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:15.256695 30192 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:15.257256 30219 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.257599 30197 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.257697 30219 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.258139 30197 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.259425 30184 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:15.259603 30219 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.259918 30197 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.260159 30219 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.260423 30197 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.211931 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.211014 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.254798 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.237160 28104 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:15.238538 30213 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.261219 30202 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.193638 30220 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.272472 30220 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.271730 27955 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:15.265194 30174 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.273131 30218 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.273487 30174 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.241909 30210 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.250880 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.248330 30226 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.279747 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.252887 30228 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.252622 30229 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.252899 30189 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:15.280970 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.177482 30205 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.269867 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.225350 30221 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.275159 27959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9196b781b73d42de863558f5a560cce2"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:15.273654 30218 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.287603 30218 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.287468 30192 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.276883 30174 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.277046 30215 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.254478 30217 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.287925 30186 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.277562 30124 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.277763 30207 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.266356 30203 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.229542 30194 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.279821 30226 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.254128 28617 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:58:15.281574 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.260636 30219 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.270759 30202 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.280445 30228 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.280748 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.290344 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.320037 30183 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:15.321247 30185 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:15.288811 30217 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:15.280591 30229 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.283957 30184 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:15.284669 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 1843) took 1043 ms. Trace:
I20260503 07:58:15.284981 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.285349 30205 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.331079 30195 raft_consensus.cc:1064] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1: attempting to promote NON_VOTER 25017111886b42cfa5701a39de59b6ad to VOTER
I20260503 07:58:15.331734 30229 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.332086 30186 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.332496 30232 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.332114 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.333850 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.334729 28622 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 LEARNER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260503 07:58:15.286059 28101 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:15.286199 30221 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.283020 30083 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.281901 28619 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:15.269500 28583 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.283821 27959 raft_consensus.cc:606] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:15.283077 28100 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:58:15.265923 30211 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:15.289342 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.327935 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.328698 30228 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.335624 30185 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.341269 30185 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:15.332669 30184 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.341900 30184 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
W20260503 07:58:15.347708 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 78666.2us
I20260503 07:58:15.321664 28107 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
W20260503 07:58:15.335618 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 51265us
I20260503 07:58:15.336410 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.289883 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:15.338742 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.338495 30083 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.338521 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.388315 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260503 07:58:15.389832 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:15.328696 30183 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.392468 30183 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:15.392795 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.327587 28029 rpcz_store.cc:276] 0503 07:58:14.241126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:15.169929 (+928803us) service_pool.cc:224] Handling call
0503 07:58:15.170425 (+ 496us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:15.170728 (+ 303us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:15.170752 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:15.174333 (+ 3581us) log.cc:844] Serialized 548 byte log entry
0503 07:58:15.237567 (+ 63234us) raft_consensus.cc:1645] Marking committed up to 2
0503 07:58:15.237602 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:15.237654 (+ 52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:15.284492 (+ 46838us) raft_consensus.cc:1685] finished
0503 07:58:15.284511 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:15.284621 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":62955,"threads_started":1,"wal-append.queue_time_us":63226}
I20260503 07:58:15.358012 30189 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:15.333557 30195 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.397830 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.363247 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.366189 30194 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.366539 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.367213 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.260958 30197 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:15.368885 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.371424 30184 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.373243 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.321254 30219 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.332989 30232 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.375049 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.373996 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.293174 30192 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.404789 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.376823 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.338259 27954 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:15.384853 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.385757 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.409245 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.404495 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.409978 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:15.367427 30185 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.391889 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.361462 28109 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260503 07:58:15.329066 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.402745 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.403057 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.297854 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.410533 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.413745 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.413971 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.414790 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.414918 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.415354 27954 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:15.418220 30184 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.418393 30206 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:15.418713 30206 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.419035 30206 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:15.419157 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.420197 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.400987 30189 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.421238 30189 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:15.421265 30185 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.414371 27959 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:15.422456 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:15.429841 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 132050us
I20260503 07:58:15.429914 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.431602 30205 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:15.431876 30186 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:15.432354 30186 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.432682 30186 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:15.405967 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.432037 30205 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.433732 30205 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:15.434082 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.433094 30219 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.435068 30219 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.435575 30197 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.436228 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.436781 30219 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.419071 30083 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.437189 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.438653 30083 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:15.372726 30217 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.441429 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.441969 27959 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:15.442312 30217 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.428799 30192 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:15.443104 30192 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.443323 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.443884 27956 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:15.441582 30216 raft_consensus.cc:993] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:15.444589 30216 raft_consensus.cc:1081] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Signalling peer be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:15.388847 30211 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.446511 27957 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:15.446609 30232 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.401237 30124 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260503 07:58:15.447917 30211 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.443459 30192 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:15.449724 28621 raft_consensus.cc:1240] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:15.413713 30194 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.452988 30194 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.454720 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.454813 30194 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.456276 30205 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.458334 27953 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:15.423162 27951 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:15.463131 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.464332 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.464668 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.465178 30185 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:15.465282 30202 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.465577 30185 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.466015 30185 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:15.466226 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.467553 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.468824 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.470103 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.471189 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.473297 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.473528 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.476552 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.481375 30184 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:15.481737 30184 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.482103 30184 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:15.483937 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.482043 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.519675 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.592778 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.581427 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:15.539628 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 135232us
I20260503 07:58:15.581776 30185 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:15.521543 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.526829 30186 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.526772 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.484375 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.526346 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.484436 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.527231 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.526480 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.546558 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.519899 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.483968 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.521234 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.517694 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:15.484967 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.568039 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.493836 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:15.583369 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.527849 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.591895 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.582821 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.579814 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.554693 30126 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260503 07:58:15.665436 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.658555 27953 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:15.666648 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.595268 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.652484 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:15.668304 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 121823us
I20260503 07:58:15.667477 27955 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:15.670127 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:15.592837 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 110821us
I20260503 07:58:15.670722 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.671525 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:15.668432 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.506294 30226 consensus_queue.cc:1059] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260503 07:58:15.561877 30206 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.670547 28073 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.525529 30192 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.594798 30205 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:15.737757 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 67278.2us
I20260503 07:58:15.737841 30221 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:15.671783 28105 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:15.738479 30221 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.738888 30221 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:15.739509 30206 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.739645 28106 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9196b781b73d42de863558f5a560cce2"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:43228
I20260503 07:58:15.740435 28106 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:15.741026 28106 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:15.741891 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.720256 28583 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:15.673566 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.519016 30183 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.740388 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.739527 28073 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.658555 27951 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:15.745124 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.746160 30186 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.762365 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.763500 28583 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:15.763731 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.746315 27952 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260503 07:58:15.747108 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.747720 30217 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:15.744303 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.749709 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.577958 30184 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.593524 30188 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:15.754675 30200 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:15.727861 28617 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 LEARNER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260503 07:58:15.684690 30189 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.757004 30192 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.758340 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.759898 30194 raft_consensus.cc:3055] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:15.679416 30195 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:15.765540 30238 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:15.768716 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.781183 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:15.761511 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:15.782234 28614 raft_consensus.cc:1240] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:15.793071 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.682034 30185 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.778262 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:15.771490 30188 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.781812 30200 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.786502 30184 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.799304 28106 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.786630 30183 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.787638 30195 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.800266 28619 raft_consensus.cc:1240] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:15.771572 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:15.801460 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:15.768637 30205 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:15.814725 28106 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:15.794102 30186 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:15.801811 30188 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:15.784373 30194 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:15.799113 30231 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:15.821643 28073 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.801870 30200 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:15.806442 30192 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:15.825990 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:15.814571 30195 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:15.806591 30083 consensus_queue.cc:1059] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260503 07:58:15.816516 30186 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.813973 30205 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.833173 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:15.833336 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:15.821442 30231 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.836097 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:15.849181 30231 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:15.849598 28614 raft_consensus.cc:2393] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 2: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:15.837706 30220 consensus_queue.cc:1059] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:15.838940 27924 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:15.840524 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:15.831312 30186 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:15.853585 30236 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:15.855280 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:15.855131 30188 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.856846 30188 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.831885 30222 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260503 07:58:15.861301 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:15.864557 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:15.830678 30228 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:15.841938 30194 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.827319 30215 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:15.866010 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:15.866261 30215 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.833528 30205 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:15.847528 30189 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.848006 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 292) took 1382 ms. Trace:
I20260503 07:58:15.848140 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:15.823673 30221 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.879601 30225 raft_consensus.cc:3055] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:58:15.879992 30225 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:15.865211 30228 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:15.881350 30228 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:15.881027 30225 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.882443 30225 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:15.885195 30221 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.866792 28614 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:15.869338 27857 rpcz_store.cc:276] 0503 07:58:14.465518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:15.054098 (+588580us) service_pool.cc:224] Handling call
0503 07:58:15.847948 (+793850us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:15.377418 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:15.378047 (+ 629us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:15.378092 (+ 45us) write_op.cc:435] Acquired schema lock
0503 07:58:15.378112 (+ 20us) tablet.cc:662] Decoding operations
0503 07:58:15.378450 (+ 338us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:15.378503 (+ 53us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:15.378536 (+ 33us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:58:15.378735 (+ 199us) tablet.cc:701] Row locks acquired
0503 07:58:15.378755 (+ 20us) write_op.cc:260] PREPARE: finished
0503 07:58:15.378881 (+ 126us) write_op.cc:270] Start()
0503 07:58:15.378991 (+ 110us) write_op.cc:276] Timestamp: P: 1777795095378842 usec, L: 0
0503 07:58:15.379013 (+ 22us) op_driver.cc:348] REPLICATION: starting
0503 07:58:15.379681 (+ 668us) log.cc:844] Serialized 591 byte log entry
0503 07:58:15.684286 (+304605us) op_driver.cc:464] REPLICATION: finished
0503 07:58:15.829739 (+145453us) write_op.cc:301] APPLY: starting
0503 07:58:15.830984 (+ 1245us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:15.842609 (+ 11625us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:15.842713 (+ 104us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:15.842904 (+ 191us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:15.843044 (+ 140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:58:15.843083 (+ 39us) write_op.cc:312] APPLY: finished
0503 07:58:15.843243 (+ 160us) log.cc:844] Serialized 23 byte log entry
0503 07:58:15.843387 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:15.843457 (+ 70us) write_op.cc:454] Released schema lock
0503 07:58:15.843490 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:15.843804 (+ 314us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:15.843829 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6233,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":131713,"apply.run_cpu_time_us":1394,"apply.run_wall_time_us":18547,"num_ops":1,"prepare.queue_time_us":117445,"prepare.run_cpu_time_us":9102,"prepare.run_wall_time_us":140868,"raft.queue_time_us":205578,"raft.run_cpu_time_us":8768,"raft.run_wall_time_us":76362,"replication_time_us":305109,"thread_start_us":366417,"threads_started":4,"wal-append.queue_time_us":96744}]]}
I20260503 07:58:15.871532 28619 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:15.869766 30226 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:15.865535 27842 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 91 similar messages]
I20260503 07:58:15.893621 30228 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.895685 30228 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.896299 30231 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.899924 30194 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:15.867954 30215 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:15.900804 30226 consensus_queue.cc:1059] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260503 07:58:15.902313 30124 raft_consensus.cc:3055] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:15.902719 30124 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:15.903389 30231 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.903609 30124 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.850445 30126 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:15.905472 30124 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:15.910671 30220 raft_consensus.cc:3055] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:15.910521 30195 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.911235 30220 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:15.912611 30195 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:15.913129 30185 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.913249 30188 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:15.913591 30185 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.912202 30220 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:15.913727 30188 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.914767 30220 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:15.915292 30185 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.915508 30188 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.915719 30185 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.915989 30188 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:15.916141 30185 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.916419 30188 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.918251 30185 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.918071 30200 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.919538 30188 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.919546 30200 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.923867 28029 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:15.929108 27952 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
W20260503 07:58:15.940726 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:15.950067 27857 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index 6 to 7, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:15.956640 28103 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:15.958343 28104 raft_consensus.cc:1240] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:15.959141 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:15.960321 28643 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1720 after lost signal to thread 26795
I20260503 07:58:15.964219 30205 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.948145 30186 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:15.968371 28106 raft_consensus.cc:1240] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 1. Current term is 2. Ops: []
W20260503 07:58:15.981549 28643 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc3c0 after lost signal to thread 27891
W20260503 07:58:15.983083 28643 debug-util.cc:398] Leaking SignalData structure 0x7b080030aa80 after lost signal to thread 27984
I20260503 07:58:15.984067 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:15.984382 28643 debug-util.cc:398] Leaking SignalData structure 0x7b080030a220 after lost signal to thread 28059
I20260503 07:58:15.986483 30186 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:15.987295 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:15.988593 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:15.989691 28029 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
W20260503 07:58:15.990758 28643 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7e60 after lost signal to thread 28133
W20260503 07:58:15.991401 27842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 125895us
I20260503 07:58:15.992060 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
W20260503 07:58:15.992370 28643 debug-util.cc:398] Leaking SignalData structure 0x7b0800334c40 after lost signal to thread 28647
W20260503 07:58:15.992986 28643 debug-util.cc:398] Leaking SignalData structure 0x7b080038ef40 after lost signal to thread 29806
I20260503 07:58:15.998760 30228 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260503 07:58:16.010737 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 140417us
I20260503 07:58:16.013620 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.017508 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.021561 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.023293 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:16.025826 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.029161 30200 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:16.029230 30238 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:16.030481 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.030568 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.031620 28583 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.032248 30217 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:16.032609 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.032943 30217 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:15.999193 30215 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.034261 30217 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:58:16.035392 30215 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:16.001508 30222 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260503 07:58:16.043181 30197 consensus_queue.cc:1059] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:16.044567 30229 raft_consensus.cc:3055] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:16.045043 30229 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:16.046064 30229 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.049788 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:16.029631 30200 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:16.054527 30229 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:16.065373 30200 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:16.054929 30224 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:16.060750 30205 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:16.060988 27842 catalog_manager.cc:5201] ChangeConfig:REMOVE_PEER RPC for tablet 77488bc798a841d697b108fb23d5531b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 37e72845941344c9b0aaa7235a6f4473 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:58:16.069901 27842 catalog_manager.cc:4729] TS be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): ChangeConfig:REMOVE_PEER RPC failed for tablet 904abdfb5f89462c8a674a30012ffef3: Remote error: Service unavailable: leader transfer in progress
I20260503 07:58:16.080586 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
W20260503 07:58:16.083503 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 60265.7us
I20260503 07:58:16.084555 28073 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:16.084692 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.085552 30228 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:58:16.084297 30192 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.092916 30192 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.095444 30192 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:16.097455 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.099012 30222 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:16.099607 30222 raft_consensus.cc:697] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:16.099879 30251 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:16.100802 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:16.096625 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.100490 30222 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.104857 28585 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:16.105902 30192 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:16.108240 30251 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:16.108359 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:16.108667 30251 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:16.109194 30251 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:16.096043 30200 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.109400 30249 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:16.109807 30249 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:16.110215 30249 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:16.111203 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.114127 30200 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.114617 30186 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:16.115991 30251 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.121321 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.122275 30251 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.123150 28103 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:16.116853 30249 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.124171 30215 raft_consensus.cc:993] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:16.124581 30215 raft_consensus.cc:1081] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:16.125097 30249 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.120085 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:16.132820 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.133869 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.134768 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.136411 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.146523 28614 raft_consensus.cc:1240] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:16.149153 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.149466 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.149571 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.150640 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.150763 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.151477 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.152107 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.151548 30229 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.154677 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.155465 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.168869 28108 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.178194 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.179622 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.180707 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.181874 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.182471 28104 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:16.183372 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.184095 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.185652 28102 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:16.185865 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.186766 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.189445 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.190250 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.191488 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.192070 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.193423 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.194298 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.196657 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.197731 30251 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:16.216343 30249 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:16.217514 30249 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.198222 30251 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:16.217666 27857 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 2 to 3, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:16.220113 30251 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.220958 30249 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.227027 30200 raft_consensus.cc:993] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:16.227427 30200 raft_consensus.cc:1081] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:16.235697 27999 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.236387 30249 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:16.239589 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.240604 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.243692 30249 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:16.245606 30249 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:16.245954 30249 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:16.246269 30249 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:16.254410 27999 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:16.254202 28619 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.255309 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.257879 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.258880 27999 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:16.259881 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.260878 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:16.260159 27857 catalog_manager.cc:5671] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.261374 30188 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:16.261605 30185 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:16.261999 30185 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:16.262192 30184 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:16.262342 30185 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:16.262579 30184 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:16.262955 30184 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:16.247783 30205 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.267980 30185 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.269760 30185 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:16.270642 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.271958 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.272780 30188 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:16.276280 28619 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.260459 30186 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:16.256011 30251 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:16.278374 30251 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:16.278698 30251 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:16.279332 30185 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:16.256026 30200 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:16.281613 27999 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.281967 30200 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:16.282348 30200 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:16.282588 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.282709 30185 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260503 07:58:16.283243 30186 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:16.284261 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.284863 30186 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:16.289726 27856 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 5 to 6, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.311503 30251 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.311590 30249 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.314976 30249 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.318243 30200 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.318892 27952 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.319994 30200 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:16.301163 30184 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.345755 30184 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:16.359586 30251 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:16.378065 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 90923.5us
I20260503 07:58:16.379388 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.380612 30256 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:16.383757 28029 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:16.383826 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.384564 28034 raft_consensus.cc:1240] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:16.385043 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.385764 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.386276 28034 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:16.387488 28034 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:16.388938 28033 raft_consensus.cc:1240] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:16.390671 28026 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:16.393947 28034 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:16.413434 28034 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:16.414652 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.415175 28034 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:16.416445 28034 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:16.417695 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.418306 28034 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:16.419814 28034 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:16.420735 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.421428 28026 raft_consensus.cc:2393] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.421679 28034 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:16.422935 30192 consensus_queue.cc:1059] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:16.423810 30182 raft_consensus.cc:3055] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:16.424135 30182 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:16.424912 30182 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.426297 30182 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:16.435405 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.436192 28034 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:16.438683 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.439172 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.439191 28026 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:16.439976 28034 raft_consensus.cc:2393] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.440634 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.442035 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.442557 28026 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:16.445088 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.446401 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.447677 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.452538 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.454106 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.454347 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.454876 28026 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:16.455673 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.457095 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:16.458807 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:16.460498 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.462213 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.468549 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.470139 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.470672 28033 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:16.471730 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.472244 28033 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:16.474941 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.475824 28033 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:16.476714 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.477466 28026 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:16.479347 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.479585 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.479851 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.480433 28026 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:16.481448 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.483870 28033 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:16.485378 28028 raft_consensus.cc:1240] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260503 07:58:16.487164 28028 raft_consensus.cc:1240] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:16.498268 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.499619 28028 raft_consensus.cc:1240] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 1. Current term is 2. Ops: []
I20260503 07:58:16.501657 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.507622 28028 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.509202 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.509837 28028 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.511013 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.514899 28103 consensus_queue.cc:237] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.519445 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.521090 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.522397 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.524314 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.531373 28029 raft_consensus.cc:1240] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:16.533619 30238 consensus_queue.cc:1059] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:16.534433 30238 raft_consensus.cc:3055] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:16.534700 30238 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:16.526392 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.535432 30238 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.536177 28028 raft_consensus.cc:2393] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.536577 30238 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:16.536413 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.538484 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.539194 28026 raft_consensus.cc:2393] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.540333 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.541646 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.542232 28026 raft_consensus.cc:2393] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:16.543246 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.543994 28026 raft_consensus.cc:2393] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.545029 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.547712 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.549613 28026 raft_consensus.cc:1240] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:16.550606 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.554447 28619 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:58:16.555958 30224 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:16.561532 27954 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260503 07:58:16.562772 30224 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:16.568063 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.570602 30205 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.574218 28619 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.576983 27952 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.591971 27856 catalog_manager.cc:5671] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 3 to 4, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New cstate: current_term: 1 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.607008 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 904abdfb5f89462c8a674a30012ffef3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 5)
I20260503 07:58:16.608639 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.615111 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.617976 28026 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:16.619445 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.620406 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.621647 28033 raft_consensus.cc:2393] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.631181 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.631858 28033 raft_consensus.cc:2393] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.633378 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.634622 28026 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.633998 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.639820 28033 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 10: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:16.641067 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:16.643343 28028 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260503 07:58:16.667116 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:16.668416 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:16.669746 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:16.673406 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:16.676637 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:16.681705 28619 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260503 07:58:16.682281 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:16.684227 30224 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:16.684955 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.686473 28028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:16.688230 28026 raft_consensus.cc:2955] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:16.699877 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.700031 28033 raft_consensus.cc:1240] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:16.702955 30238 consensus_queue.cc:1059] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:16.703742 30238 raft_consensus.cc:3055] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:16.704017 30238 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:16.707712 30203 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.708122 27958 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260503 07:58:16.704674 30238 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.708155 30203 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.710129 30226 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.710852 30203 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:16.710677 30226 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.711400 30228 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:16.712534 30226 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:16.710419 30238 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:16.714331 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:16.714694 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:16.725319 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.726980 30226 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.727460 30226 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.729246 30226 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.731940 30226 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.732450 30226 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.734258 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.736089 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.736332 30226 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.742873 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:16.746493 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:16.748162 28103 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:16.750357 30228 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.750839 30228 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.752483 30228 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:16.752605 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.754829 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:16.755930 30228 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.756397 30228 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.758517 30228 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:16.759759 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.760656 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.762331 27956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:16.762837 27956 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:16.763094 27956 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:16.770489 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.775182 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.775894 27956 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.779700 27956 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:16.781188 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:16.781776 27954 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:16.783540 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.781760 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.784965 28108 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:16.784901 28073 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:16.783952 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.786639 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.783499 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:16.787500 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:16.790380 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:16.796343 28108 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:16.795325 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:16.797493 27926 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:16.788535 30193 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:16.798338 30193 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:16.798772 30193 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:16.802191 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:16.803340 28021 tablet_service.cc:1558] Processing DeleteTablet for tablet 904abdfb5f89462c8a674a30012ffef3 with delete_type TABLET_DATA_TOMBSTONED (TS adaf84b6ac60420ab03d39b9db9f0413 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33286
I20260503 07:58:16.804683 30186 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:16.804791 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.805557 30186 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:16.805912 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.806146 30188 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:16.806659 30200 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:16.805912 30186 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:16.807601 30186 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.808555 30186 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:16.809206 30197 consensus_queue.cc:1059] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:16.807017 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.815469 27924 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:16.816818 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.818399 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.820338 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.823925 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.822446 30200 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:16.837539 30200 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:16.823401 30256 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:16.839184 30256 raft_consensus.cc:3055] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:16.839545 30256 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:16.841979 28614 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:16.822543 30249 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:16.845490 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:16.823082 30251 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:16.825451 30184 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260503 07:58:16.868922 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 71688.9us
I20260503 07:58:16.876959 28075 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:16.878501 28075 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:16.879633 28075 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:16.840512 30256 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.841611 30188 consensus_queue.cc:1059] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260503 07:58:16.884299 30266 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:16.884440 30188 raft_consensus.cc:3055] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:16.884887 30188 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:16.885593 30188 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.886792 30188 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:16.887384 30193 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:16.892818 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 77404.3us
I20260503 07:58:16.878870 30197 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:16.875388 30226 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:16.882225 30207 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:16.877571 28621 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:16.895825 30222 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:16.892481 30193 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:16.881315 30228 consensus_queue.cc:1059] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260503 07:58:16.920678 30228 raft_consensus.cc:3055] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:58:16.921038 30228 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:16.921829 30228 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.923111 30228 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:16.928519 28617 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:16.935499 30203 raft_consensus.cc:3055] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:16.935875 30203 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:16.898881 30265 consensus_queue.cc:1059] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260503 07:58:16.938728 30264 raft_consensus.cc:3055] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:16.939064 30264 raft_consensus.cc:740] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:16.939770 30264 consensus_queue.cc:260] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:16.936599 30203 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:16.949872 30203 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:16.979393 30266 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:16.981448 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 100894us
I20260503 07:58:16.991187 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:16.992746 28075 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:16.993921 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:16.985353 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 164770us
I20260503 07:58:16.995033 27926 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:16.996405 27926 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:17.006709 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 178896us
I20260503 07:58:17.008764 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.008747 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.014087 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.015952 28075 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.014655 30197 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.019281 27999 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.020586 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.021778 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.014816 30186 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.017371 30266 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.023528 30200 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.010136 30205 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:17.024164 30184 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.009675 30226 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:17.013777 30193 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.006992 30267 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.026022 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:17.027026 27958 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.027506 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.025985 30272 consensus_queue.cc:1059] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260503 07:58:17.026209 30226 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.029994 30226 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.016399 30268 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.025533 30274 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260503 07:58:17.033661 30184 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:17.036159 28075 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.035696 30273 consensus_queue.cc:1059] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:17.036293 27926 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.037657 28075 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.038378 30269 consensus_queue.cc:1059] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:17.038683 30224 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.039453 30273 raft_consensus.cc:3055] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:17.036818 30265 consensus_queue.cc:1059] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260503 07:58:17.039784 28033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:17.039839 28075 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.040624 28033 raft_consensus.cc:606] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:17.040802 30265 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:17.040995 28033 raft_consensus.cc:614] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:17.041107 30224 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.041214 30265 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.042140 30265 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.043116 30265 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
W20260503 07:58:17.045243 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.046824 30256 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.046980 30267 raft_consensus.cc:3055] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:17.047340 30267 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.047797 30224 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.048035 30267 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.037549 30205 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.049437 30184 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:17.050022 30184 consensus_queue.cc:1059] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:17.051770 30184 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:17.052076 30184 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.039808 30273 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.053622 28075 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.053892 30273 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.056265 30273 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.035506 30207 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.058499 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.058569 28075 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.060642 30276 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:17.061322 30276 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.026826 30203 consensus_queue.cc:1059] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260503 07:58:17.061699 30276 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.061946 28033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:17.062449 30272 raft_consensus.cc:3055] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:17.058642 30267 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.062970 30272 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.063805 30272 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.035991 30271 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.060554 30268 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.064958 30272 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.067955 28028 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:17.068248 30263 tablet_replica.cc:333] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: stopping tablet replica
I20260503 07:58:17.068346 28028 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:17.058250 30264 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.073186 30249 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260503 07:58:17.073148 30197 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.073904 30249 consensus_queue.cc:1059] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:17.074683 30184 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.075434 30274 raft_consensus.cc:3055] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:17.075721 30184 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.062485 28033 raft_consensus.cc:606] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:17.075740 30274 raft_consensus.cc:740] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.075879 30207 consensus_queue.cc:1059] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:17.077098 30268 raft_consensus.cc:3055] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:17.076849 30274 consensus_queue.cc:260] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.077476 30268 raft_consensus.cc:740] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.078173 30274 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.078181 30268 consensus_queue.cc:260] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.078860 27999 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:17.079793 30249 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:17.080185 30268 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.080334 30249 raft_consensus.cc:697] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.081619 30249 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.084705 27999 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:17.085741 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:17.086437 30186 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:17.086895 30186 raft_consensus.cc:697] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.087590 30186 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.074272 28028 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.089212 30188 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:17.089404 28075 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.089712 30188 raft_consensus.cc:697] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.076828 30266 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.091639 30269 consensus_queue.cc:1059] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:17.091085 30263 raft_consensus.cc:2243] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260503 07:58:17.092610 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 44223.6us
I20260503 07:58:17.092805 27958 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:17.094414 28108 raft_consensus.cc:1240] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:17.094520 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.094506 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.100163 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.101459 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.102396 28103 raft_consensus.cc:1240] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:17.103490 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.103632 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.105086 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.104864 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.105521 28029 raft_consensus.cc:3055] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:17.106091 28029 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.106755 28029 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.107667 28029 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.060149 30224 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.108377 28108 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:17.109849 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.108709 28028 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.110972 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.111450 28073 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:17.109091 30271 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.092607 30207 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:17.115756 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.117061 28075 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.117653 30193 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:17.122501 28029 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:17.090606 30188 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.125267 28109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:17.125819 28109 raft_consensus.cc:606] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.126152 28109 raft_consensus.cc:614] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:17.113057 30251 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260503 07:58:17.117385 30265 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:17.128587 30207 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.136984 30251 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.127859 30193 raft_consensus.cc:697] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.141032 30277 consensus_queue.cc:1059] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260503 07:58:17.141996 30277 raft_consensus.cc:3055] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:17.142336 30277 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.142107 30276 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.143025 30277 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.143862 30276 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.141991 30193 consensus_queue.cc:237] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.144163 30277 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.149443 30226 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.151165 30226 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.154763 30205 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.158257 30224 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:17.182569 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.133962 30265 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.197886 30265 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.215021 28105 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:17.214954 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.225126 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.228351 27958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "25017111886b42cfa5701a39de59b6ad"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:17.229082 27958 raft_consensus.cc:606] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Received request to transfer leadership to TS 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:17.229527 27958 raft_consensus.cc:614] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260503 07:58:17.230388 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 113415us
I20260503 07:58:17.227381 30265 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.231083 28075 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.231815 30263 raft_consensus.cc:2272] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260503 07:58:17.232087 28075 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:17.232844 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 121938us
I20260503 07:58:17.235174 30279 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.237200 30265 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.238250 28075 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.238509 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.238741 30224 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.239230 30193 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.234319 27999 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.240551 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.244735 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260503 07:58:17.244877 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.246450 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:17.246424 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.247519 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:17.249709 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.246291 30274 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.247531 30284 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.250885 30251 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.242940 30228 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:17.257553 30279 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.245214 30207 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260503 07:58:17.261380 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.261886 28109 raft_consensus.cc:1813] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Handling vote request from an unknown peer adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.260937 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:17.262185 28109 raft_consensus.cc:3055] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260503 07:58:17.262439 28109 raft_consensus.cc:740] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.249308 30249 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.229143 30226 consensus_queue.cc:1059] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260503 07:58:17.263056 28109 consensus_queue.cc:260] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.229288 30272 consensus_queue.cc:1059] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260503 07:58:17.262704 28617 raft_consensus.cc:1813] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Handling vote request from an unknown peer adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.264511 28109 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:17.266431 28105 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:17.264853 28617 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:17.275856 30249 consensus_queue.cc:1059] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:17.276772 30249 raft_consensus.cc:3055] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:17.277128 30249 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.277490 30193 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.277980 30249 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.279098 30249 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.285136 30251 consensus_queue.cc:1059] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:17.285543 30226 raft_consensus.cc:3055] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:17.285970 30226 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.286357 30251 raft_consensus.cc:3055] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:17.286881 30251 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.286749 30226 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.287927 28109 raft_consensus.cc:2410] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260503 07:58:17.288029 30226 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.289598 30203 raft_consensus.cc:3055] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:17.289981 30203 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.290086 30263 ts_tablet_manager.cc:1916] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:17.290755 30203 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.291836 30203 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.299968 30200 consensus_queue.cc:1059] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:17.300755 30200 consensus_queue.cc:1243] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer be26cebb7c90445ea9a74f66463457c1 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260503 07:58:17.301432 30184 raft_consensus.cc:3055] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:17.301826 30184 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:17.302597 30184 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.303381 30267 raft_consensus.cc:3055] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:17.303726 30267 raft_consensus.cc:740] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:17.304387 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.304428 30267 consensus_queue.cc:260] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:17.305006 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.305615 30267 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:17.307049 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.295825 30251 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.309252 30184 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.313876 30272 raft_consensus.cc:3055] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:17.311838 30224 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.314297 30272 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.312518 30251 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.315447 30272 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.316802 30272 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.335247 30192 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:17.339932 30192 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:17.342063 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.350955 27856 catalog_manager.cc:5671] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:17.353027 28617 raft_consensus.cc:2410] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260503 07:58:17.354763 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 112087us
I20260503 07:58:17.355895 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:17.355984 27999 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.356488 27958 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:17.356519 28075 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.357630 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:17.357820 28075 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.359575 28075 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:17.362629 27999 raft_consensus.cc:2686] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260503 07:58:17.351821 30192 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:17.365545 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 271089us
I20260503 07:58:17.367156 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.368311 27926 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.355837 30283 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:17.374048 27926 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.373980 28075 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.378414 27926 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.379434 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.380380 27926 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.358968 30268 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.381917 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.359769 30193 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.373253 30207 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.377873 30197 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.387529 27857 catalog_manager.cc:5671] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:17.381161 30192 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260503 07:58:17.392881 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 149448us
I20260503 07:58:17.381546 30267 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.386905 30282 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:17.387846 30226 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.387260 30273 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:17.389197 30264 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.400806 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.396178 30192 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:17.385795 30283 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.401626 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.391227 30228 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:17.390377 30281 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.403698 27952 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:17.404054 27956 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:17.405010 30192 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.411696 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:17.431970 28617 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:17.433560 27924 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:17.434556 30264 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:17.435057 30264 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:17.435446 30264 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.424610 30197 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.402222 30273 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.437328 30273 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.426402 30281 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.400734 30282 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.442214 30282 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.448956 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:17.449379 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.449833 28105 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:17.452040 28108 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:17.404081 27855 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:17.453668 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:17.454185 28103 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:17.457299 30273 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.463897 30264 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.452972 27855 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260503 07:58:17.467451 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:17.467864 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.403177 30290 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:17.410837 30283 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.427069 27926 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.466758 27855 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 5 to 6, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:17.470635 30283 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 07:58:17.471158 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 44186.4us
I20260503 07:58:17.473394 27926 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.471972 30192 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.476616 30288 consensus_queue.cc:1059] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:17.477373 30266 consensus_queue.cc:1059] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:17.477555 30288 raft_consensus.cc:3055] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:17.477911 30288 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.478191 30266 raft_consensus.cc:3055] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:17.478507 30266 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.478581 30288 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.479202 30266 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.479851 30288 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.480508 30266 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.482558 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:17.483304 30282 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:17.492834 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 92082.6us
I20260503 07:58:17.493580 28075 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.491708 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.488791 30283 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.496917 27926 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.497622 30272 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.488562 27952 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:17.498761 30228 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.499783 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:17.500594 30238 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:17.501055 30238 raft_consensus.cc:697] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:17.501766 30238 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.505332 28075 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.506677 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.507596 30224 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.517684 30272 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:17.517765 28619 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260503 07:58:17.518162 30272 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.518415 28103 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:17.518576 30272 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.519254 30186 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:17.521325 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.521445 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.521865 28103 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.525758 30226 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.526408 30272 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.528793 28103 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:17.531476 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.534292 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.509057 30273 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.508627 30192 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.516319 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.541530 28108 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:17.511294 30264 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.534931 30224 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.512104 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:17.543404 28617 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.538757 27924 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:17.547412 28029 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:17.549376 27952 raft_consensus.cc:1240] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:17.543606 30283 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260503 07:58:17.553092 30288 consensus_queue.cc:1059] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:17.538021 30226 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:17.554400 30226 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.554728 30266 raft_consensus.cc:3055] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:17.555195 30266 raft_consensus.cc:740] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.556582 30226 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.484988 30282 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.558192 28617 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:17.548764 30263 ts_tablet_manager.cc:1929] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260503 07:58:17.563483 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:17.564375 28103 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:17.567340 27926 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.570590 27926 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.571440 27926 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.572335 27926 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.573112 27926 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.539222 30272 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.556111 30266 consensus_queue.cc:260] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.576566 27926 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.568464 30238 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:17.593273 27952 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:17.600425 27956 raft_consensus.cc:1240] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:17.574306 30263 log.cc:1199] T 904abdfb5f89462c8a674a30012ffef3 P adaf84b6ac60420ab03d39b9db9f0413: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/wals/904abdfb5f89462c8a674a30012ffef3
I20260503 07:58:17.575610 30273 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:17.633088 30222 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:17.575140 30283 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.574186 30226 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.592044 30267 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:17.573983 30282 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:17.561647 30264 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:17.635604 28034 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:58:17.637542 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 61063.2us
I20260503 07:58:17.583122 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:17.640106 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.641705 27926 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.642339 30273 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:17.642684 30273 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.642933 30283 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:17.643114 30273 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.643338 30283 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.639077 30272 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:17.643782 30283 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.644008 30272 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.644404 30272 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.642656 27926 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.649912 30197 raft_consensus.cc:2749] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:17.650312 27926 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.650631 30283 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.638549 30267 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.651626 30267 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.651762 27926 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.652796 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.653183 30203 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.654990 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:17.656159 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.658567 28617 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:17.659052 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.653566 30283 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.662698 27924 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.635181 30224 consensus_queue.cc:1059] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260503 07:58:17.633711 30238 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.661260 30289 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:17.653774 30203 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:17.668161 30289 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.669330 30289 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.662837 30197 consensus_queue.cc:1059] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260503 07:58:17.670120 30197 raft_consensus.cc:3055] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:17.670464 30197 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.671154 30197 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.668205 30203 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:17.676366 30203 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.684582 27854 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260503 07:58:17.689585 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.694074 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.694628 28029 raft_consensus.cc:2468] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:17.695591 28585 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:17.696288 27952 raft_consensus.cc:1240] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:17.696941 30279 raft_consensus.cc:3055] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:17.697173 30192 raft_consensus.cc:2804] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:17.697371 30279 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.697623 30192 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:17.697999 30192 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.698189 30279 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.699572 30279 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:17.702982 27958 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:17.705379 30238 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.707051 30207 consensus_queue.cc:1059] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:17.707218 30205 consensus_queue.cc:1059] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:17.707643 30273 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.708003 30207 raft_consensus.cc:3055] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:17.708206 30205 raft_consensus.cc:3055] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:17.708351 30207 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.708678 30205 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.709506 30205 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.710996 30205 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:17.711218 30207 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.712483 30207 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.658877 28621 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:17.700721 30203 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.716415 30203 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.659031 30266 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.721901 28621 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:17.726420 30226 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.727016 30226 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:17.683090 30289 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.727305 30267 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.728963 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:17.729341 30264 raft_consensus.cc:697] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:17.730180 30264 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.674120 27926 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.668507 30249 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260503 07:58:17.734688 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 60636.5us
I20260503 07:58:17.735021 30289 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.734885 27924 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:17.735359 27926 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.735731 30281 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:17.736063 30289 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:17.736351 30281 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:17.736474 30289 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:17.730739 30267 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.736917 30289 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.727545 30186 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260503 07:58:17.737582 30273 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.738405 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.746481 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.739176 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.747951 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:17.749145 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.737085 30197 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.736369 27926 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.712524 30272 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.767510 28034 raft_consensus.cc:1275] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:17.772310 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:17.793231 27844 catalog_manager.cc:5002] TS adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): tablet 904abdfb5f89462c8a674a30012ffef3 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:58:17.793658 30272 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.777748 30228 consensus_queue.cc:1048] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260503 07:58:17.796720 30226 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 07:58:17.804488 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.809688 27953 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:17.822734 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:17.823230 27959 raft_consensus.cc:1813] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Handling vote request from an unknown peer adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:17.823483 27959 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:17.824039 27960 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.823446 27953 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.831012 27960 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:17.835930 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:17.837436 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.838016 30272 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:17.838629 30272 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.839766 27953 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260503 07:58:17.840749 27959 raft_consensus.cc:2410] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260503 07:58:17.805259 30192 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.852770 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.853456 28029 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.859661 28029 raft_consensus.cc:2468] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:17.867830 27855 catalog_manager.cc:5671] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:17.870842 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:17.871399 28105 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:17.875439 27924 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:17.889124 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.890415 28583 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.899957 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:17.900552 28617 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:17.881786 30226 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260503 07:58:17.901708 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 50111.6us
I20260503 07:58:17.904723 27958 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:17.884789 30192 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:17.906462 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 46024.9us
I20260503 07:58:17.907367 27956 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:17.899308 30293 raft_consensus.cc:2804] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:17.912235 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.913507 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.913918 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.914124 28030 raft_consensus.cc:1275] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:17.899139 30272 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.916967 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.917253 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.918179 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.918371 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.919281 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.920418 30188 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:17.920902 30188 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: NON_VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: true } }
I20260503 07:58:17.927134 30188 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:17.924903 30279 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:17.902680 30226 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:17.929462 30226 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.929628 30279 raft_consensus.cc:3055] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:17.930015 30279 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:17.930768 30279 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.931931 30279 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:17.910629 30249 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260503 07:58:17.916108 30186 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260503 07:58:17.933971 30293 raft_consensus.cc:697] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:17.934695 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.934824 30293 consensus_queue.cc:237] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.935248 27956 raft_consensus.cc:1240] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 2. Current term is 3. Ops: []
I20260503 07:58:17.936007 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:17.936537 28027 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:17.936602 30266 consensus_queue.cc:1059] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:17.937633 30266 raft_consensus.cc:3055] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260503 07:58:17.937916 30266 raft_consensus.cc:740] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:17.938011 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:17.938629 30266 consensus_queue.cc:260] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:17.939720 30266 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:17.942898 30251 raft_consensus.cc:993] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:17.943305 30251 raft_consensus.cc:1081] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:17.943181 30226 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.906996 30289 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:17.947031 30289 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.950079 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:17.950578 28619 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.950837 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:17.951375 28103 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 4
I20260503 07:58:17.955611 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:17.955658 27842 catalog_manager.cc:5201] ChangeConfig:REMOVE_PEER RPC for tablet 77488bc798a841d697b108fb23d5531b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 37e72845941344c9b0aaa7235a6f4473 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:17.956230 28108 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.956833 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:17.959297 28621 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.944967 30226 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:17.967308 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.968168 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.969565 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.974363 28103 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:17.974715 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:17.975183 28027 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:17.976120 28619 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:17.977699 27924 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:17.983459 28027 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:17.983574 27959 raft_consensus.cc:1240] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:17.984228 27952 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:17.989362 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:17.992518 27958 raft_consensus.cc:1240] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:17.992370 27926 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.011288 30266 consensus_queue.cc:1059] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:18.011579 30277 consensus_queue.cc:1059] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:18.012039 30226 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:18.012359 27926 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.012928 30228 consensus_queue.cc:1059] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:18.013897 27926 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.015647 27926 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.016335 30264 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:18.016932 30264 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:18.017215 30224 raft_consensus.cc:3055] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:18.017479 30264 consensus_queue.cc:1048] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:18.017742 30224 raft_consensus.cc:740] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:18.018810 30264 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:18.018604 30224 consensus_queue.cc:260] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.019680 30224 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:18.005219 28108 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:18.006860 27956 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:18.020045 27926 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:17.972787 28621 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:17.997223 30282 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:18.029737 30282 raft_consensus.cc:697] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:18.030843 27924 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.031755 30264 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:18.030572 30282 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.021678 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.033674 27926 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.036298 30289 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:18.036994 30264 raft_consensus.cc:697] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:18.038061 30228 raft_consensus.cc:3055] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:18.037937 30264 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.039475 30207 raft_consensus.cc:3055] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:18.039819 30207 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:18.038439 30228 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:18.046995 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.051520 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.052438 30203 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:18.052531 30197 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:18.048112 27855 catalog_manager.cc:5671] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 2 to 4, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 4 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:18.022181 30272 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:18.055711 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.049836 30226 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:18.040514 30207 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.062798 27956 raft_consensus.cc:1240] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:18.063408 30207 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:18.063529 30277 consensus_queue.cc:1175] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "adaf84b6ac60420ab03d39b9db9f0413" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 6 index: 5 } }
I20260503 07:58:18.033102 30293 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260503 07:58:18.065886 30277 consensus_queue.cc:1059] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:18.066010 27926 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.066748 30226 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:18.066807 30277 raft_consensus.cc:3055] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:18.067294 30277 raft_consensus.cc:740] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:18.067396 30197 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:18.069550 28101 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:18.072394 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.072588 27958 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:18.073207 27960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:18.073686 27960 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:18.074112 27960 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:18.074491 27999 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.082456 27958 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:18.083752 30184 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:18.081398 30203 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.081350 30293 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.081262 30238 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260503 07:58:18.087496 27960 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.091701 27951 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:18.085189 30266 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.092504 27960 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:18.097175 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:18.099390 30309 consensus_queue.cc:1059] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:18.089984 30228 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.100384 30309 raft_consensus.cc:3055] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:18.100723 30309 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:18.101042 30228 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:18.102195 30309 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.084012 30186 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260503 07:58:18.103433 30309 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:18.099454 28621 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:18.091570 30203 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.106909 30203 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:18.097586 30293 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.110874 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.114009 28621 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:18.121732 27924 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:18.122645 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:18.122745 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.123317 28621 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:18.123394 27960 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:58:18.111588 28101 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 2.
I20260503 07:58:18.124634 27924 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.125806 30272 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:18.126181 30272 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.127151 28583 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:18.127996 30304 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:18.128213 30197 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.128364 30304 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.128719 30304 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:18.128679 30197 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.131166 30197 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:18.132431 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.132958 28028 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:18.134224 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.136432 30304 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.137852 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:18.138192 30304 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.139375 27924 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.140524 30197 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:18.140970 30226 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:18.141521 30226 raft_consensus.cc:697] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:18.108880 30266 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.142395 30226 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.143321 30266 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:18.121213 30186 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:18.144168 30186 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.146215 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:18.147686 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.150875 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.151535 28108 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:18.154443 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:18.155910 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.073675 30277 consensus_queue.cc:260] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.166580 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:18.173645 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.145123 30272 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:18.180796 28108 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:18.183872 28583 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.169071 30293 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.164898 30228 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.185928 30304 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:18.194454 28108 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:58:18.198251 30186 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.201529 30277 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:18.201853 28621 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:58:18.171749 30238 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:18.217887 30238 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.219662 30238 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.222306 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.222944 28034 raft_consensus.cc:2393] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 2: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:18.214107 30228 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.227348 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.227849 28034 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:58:18.228595 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.228987 28031 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:18.229187 28108 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 2.
I20260503 07:58:18.230204 28583 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:18.231021 28075 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.231868 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:18.207258 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.232219 30277 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260503 07:58:18.232404 28621 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 1.
I20260503 07:58:18.232580 30277 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.232694 27953 raft_consensus.cc:2393] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:18.232944 30277 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:18.207907 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.215392 30304 raft_consensus.cc:697] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:18.216686 30282 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:18.234658 30238 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260503 07:58:18.235056 30238 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:18.235381 30238 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 1 FOLLOWER]: Advancing to term 2
I20260503 07:58:18.236044 30203 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:18.240425 28101 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:18.241520 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:18.237751 30228 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:18.252630 27855 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:18.254860 27855 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:18.245991 30309 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:18.234665 30304 consensus_queue.cc:237] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.228909 30272 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.258183 30309 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:18.281869 27959 raft_consensus.cc:2393] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:18.270525 30309 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:18.293632 30203 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.294131 30203 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.295858 30203 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.304572 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.273084 30266 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:18.317240 30249 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.317651 30249 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.323582 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.324720 28027 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:18.326956 30249 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.328811 30272 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:18.329973 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:18.331606 30293 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:18.332201 30293 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.334035 30277 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.335139 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.335870 28031 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:18.336447 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.337044 28034 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:18.331904 30238 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.344252 30309 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.345618 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:18.345700 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.358016 28619 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 2 FOLLOWER]: Advancing to term 3
I20260503 07:58:18.358237 27926 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.359786 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.360672 30203 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:18.361068 30203 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.361383 30203 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:18.361462 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.362061 28102 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:18.346016 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.363030 28109 raft_consensus.cc:2368] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad for earlier term 2. Current term is 3.
I20260503 07:58:18.335834 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.363718 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:18.351533 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.353686 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.364364 30226 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.364472 30249 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:18.364575 28103 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:18.364987 30249 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.365476 30249 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:18.365761 28101 raft_consensus.cc:2393] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 3: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:18.366897 27924 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.367834 30282 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260503 07:58:18.368755 28583 leader_election.cc:400] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad for earlier term 2. Current term is 3.
I20260503 07:58:18.369851 28583 leader_election.cc:403] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260503 07:58:18.352404 30293 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.371477 30309 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.363767 27959 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:18.369262 30226 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.374585 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:18.374585 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.375957 30249 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.385869 30226 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.386651 27956 raft_consensus.cc:2393] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:18.387595 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.388255 28109 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:18.356289 30277 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:18.389497 30249 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.389678 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.390415 30226 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:18.344815 28034 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:18.390791 30226 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.391199 30226 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.393456 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:18.393882 28075 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.394593 30277 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260503 07:58:18.395205 30277 raft_consensus.cc:697] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:18.395877 30277 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.397935 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.398473 28034 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:18.399343 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.399819 28109 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:18.356742 30238 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 2 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.372866 28619 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:18.401998 30293 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad for earlier term 2. Current term is 3.
I20260503 07:58:18.405514 30226 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.409050 30226 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.409951 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.410521 28103 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.412505 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.413060 28034 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.416478 28103 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:18.417892 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.419286 30272 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:18.419675 30272 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:18.420403 30272 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.425290 30203 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.428094 30203 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.428131 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.429095 28101 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:18.431368 30289 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.431809 30289 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.433451 30289 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.435683 28619 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:18.437259 30289 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:18.439325 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.439860 28102 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
I20260503 07:58:18.441030 27924 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.441758 30289 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:18.408213 27854 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:18.442107 30289 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.442478 30289 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:18.444468 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:18.446863 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.447760 28031 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:18.447949 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 79327us
I20260503 07:58:18.453297 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.453804 28027 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
I20260503 07:58:18.458600 28583 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:18.459178 28031 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:18.461198 27926 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.462731 30309 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:18.463181 30309 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:18.463927 30309 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.466833 30327 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:18.467206 30327 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:18.467521 30327 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:18.467726 30203 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:18.468174 30203 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:18.471230 28034 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:18.477340 28102 raft_consensus.cc:3060] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 2 FOLLOWER]: Advancing to term 4
I20260503 07:58:18.480897 28109 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:18.489310 28102 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:18.494556 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:18.491107 30282 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.484750 30327 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.496603 30251 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:18.504312 30327 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.496485 30329 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260503 07:58:18.505479 30186 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.506145 30186 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.501081 30282 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.507872 30186 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.508868 30282 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.503753 30251 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:18.511639 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.512019 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.514392 28031 raft_consensus.cc:1275] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:18.517589 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:18.520360 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.520964 28108 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:18.521718 28034 raft_consensus.cc:2393] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:18.490813 30203 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.526880 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.533360 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.533859 28102 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:18.529474 27951 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:18.546067 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.546782 28034 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:18.551514 27956 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:18.552762 28583 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:18.511297 30251 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.554412 30328 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:18.555024 30328 raft_consensus.cc:697] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:18.556824 27854 catalog_manager.cc:5671] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 1 to 3, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 3 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:18.558560 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.566334 27926 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:18.525597 30192 consensus_queue.cc:1048] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260503 07:58:18.587303 28034 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:18.560568 30328 consensus_queue.cc:237] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:18.583273 30284 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.589115 30284 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.589180 30282 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:18.590975 30284 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.574502 30309 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:18.593050 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.577069 30272 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:18.576879 30184 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.606001 28621 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:18.606842 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.607393 28108 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:18.584599 27857 catalog_manager.cc:5671] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:18.616871 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:18.598325 30309 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.605947 30272 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.654778 28108 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:18.659622 30266 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.616452 30277 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:18.660097 30266 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.660241 30277 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.617868 30197 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.660109 27854 catalog_manager.cc:5671] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:18.661243 30197 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.662431 30266 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.662700 30277 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.662388 27854 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:18.664983 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.664762 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.665531 28027 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:18.664129 27855 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:18.668630 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.669282 27956 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:18.670455 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.635290 30310 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:18.671087 30310 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.670969 30226 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260503 07:58:18.671452 30333 log.cc:927] Time spent T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260503 07:58:18.671594 30310 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:18.671053 28102 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:18.672729 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.636929 30309 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:18.673276 27951 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:18.673990 28073 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.674477 27924 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.674996 30226 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:18.675298 30226 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.675631 30226 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.615932 30282 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260503 07:58:18.645074 30272 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.618144 30289 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.678647 30289 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.614272 30184 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.672492 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.683952 28619 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:18.682622 28033 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:18.662981 30197 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.640966 30251 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.688865 28073 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.689857 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.690369 28108 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:18.663127 30188 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.697582 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:18.708879 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.708889 30228 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.709475 28033 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:18.709887 30184 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.709529 30228 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.711545 30228 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.712976 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.713501 27959 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:18.714491 28073 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.715167 30228 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:18.715524 30228 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.715833 30228 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:18.716862 28033 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 11.
I20260503 07:58:18.695746 30251 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.720050 30251 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.693099 30290 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:18.720728 30290 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.721079 30290 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:18.722127 30228 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.724997 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:18.695592 30289 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260503 07:58:18.725503 27951 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:18.727505 30226 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.689661 30207 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:18.729697 30207 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:18.730140 30207 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:18.728412 30272 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.732271 28619 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:18.731683 30226 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.698170 30188 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.739228 28103 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:18.755286 27951 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:18.756356 28073 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.756425 28108 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 11.
I20260503 07:58:18.757470 27924 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.751441 30249 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:18.772365 30277 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:18.772981 30188 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.774715 28034 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: true } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:58:18.779034 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 84431.2us
I20260503 07:58:18.779313 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.769271 30203 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260503 07:58:18.782841 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.751291 30266 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.772938 30249 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.772480 30282 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader election won for term 11
I20260503 07:58:18.786306 28103 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:58:18.789580 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.790064 28101 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
W20260503 07:58:18.792236 30338 log.cc:927] Time spent T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260503 07:58:18.792902 30249 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.792254 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.794648 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.795061 28103 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:18.795610 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:18.796017 28101 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:18.798767 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.801093 30277 raft_consensus.cc:697] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:18.801474 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.802011 28031 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.806969 30207 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.807914 28109 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.809073 28031 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:18.811928 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:18.812474 28033 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:58:18.812693 28031 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:18.790763 30228 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.814031 28109 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:18.816195 30207 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.822865 30272 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.791011 30266 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.823350 30188 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:18.824364 30343 log.cc:927] Time spent T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260503 07:58:18.823897 30188 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.824884 30266 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.825816 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.826326 28033 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 4
I20260503 07:58:18.829883 30249 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.830379 30249 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.832130 30249 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.793654 30329 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260503 07:58:18.833101 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:18.833794 28109 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.793505 30309 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.840575 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.841053 30309 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.841158 27959 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:18.841449 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:18.842053 27951 raft_consensus.cc:2368] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:18.816501 30310 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.798754 30282 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 11 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:18.816687 30277 consensus_queue.cc:237] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.817224 30287 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:18.826252 30188 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.851943 30287 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.852187 30282 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.853729 30287 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.818360 30341 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.820917 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:18.855410 28028 raft_consensus.cc:2368] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:18.821568 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.856463 27956 raft_consensus.cc:2368] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4.
I20260503 07:58:18.857028 28109 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:18.843478 27924 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.845738 28073 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.859238 28073 leader_election.cc:400] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:18.854342 30341 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.860630 28073 leader_election.cc:403] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260503 07:58:18.861745 30207 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:18.861946 30341 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.862598 30290 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.864507 30290 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.864423 27924 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.866209 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:18.849148 28033 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:18.866847 27956 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:18.859403 30197 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:18.872988 30207 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.873448 30207 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.874601 30310 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.860486 30266 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:18.875185 30207 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.875392 30266 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.875743 30266 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:18.876770 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:18.877488 27951 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:18.882571 28073 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.883620 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:18.858722 30342 log.cc:927] Time spent T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260503 07:58:18.887197 27956 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:18.887769 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.888456 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.886217 30290 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:18.889626 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:18.892915 30188 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:18.904053 30345 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.892650 30186 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:18.907351 30287 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:18.907395 30188 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.904750 30290 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.909108 30186 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.921777 30345 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.923353 30188 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:18.924888 30186 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:18.926928 30345 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.922895 30287 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:18.928620 30287 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:18.924397 30290 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:18.933629 30186 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.935657 30186 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.923007 30346 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.936370 30346 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.939448 30346 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.942652 30287 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.943660 30266 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.945173 30228 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.945930 30228 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.948164 30228 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:18.945240 30344 log.cc:927] Time spent T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260503 07:58:18.950001 30188 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.945282 30266 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.951841 30188 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.944729 30287 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:18.953243 30346 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:18.954329 30346 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.957175 30346 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:18.949733 30290 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:18.963177 30290 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:18.996752 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 132263us
I20260503 07:58:19.022882 30226 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:19.023883 30226 raft_consensus.cc:697] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:18.996394 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 89535.2us
I20260503 07:58:19.037750 30282 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260503 07:58:19.038774 28619 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:58:19.040347 30197 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:19.040834 30226 consensus_queue.cc:237] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.042011 30197 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.047515 30272 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.048370 30272 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.052527 30266 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.053403 30266 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.058568 30228 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260503 07:58:19.061941 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 62474.1us
I20260503 07:58:19.065698 28073 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.066356 30272 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.059994 30266 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.077697 30290 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:19.078702 30290 raft_consensus.cc:697] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:19.079185 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.080418 30290 consensus_queue.cc:237] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.080523 27951 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:19.088464 28108 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260503 07:58:19.091620 27959 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260503 07:58:19.092278 27956 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:58:19.093078 30329 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:19.094559 30329 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:19.106711 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:19.114916 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 228361us
I20260503 07:58:19.119014 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.119777 28108 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:19.112632 30329 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260503 07:58:19.123080 28108 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:19.139217 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.140224 27960 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.142063 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.142767 27953 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:19.145527 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.146324 27957 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.149464 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.150441 27954 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:19.172379 27924 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.174422 30272 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:19.176482 28109 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.136814 27856 catalog_manager.cc:5671] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 3 to 4, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 4 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:19.193400 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.194108 27954 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:19.197455 28109 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:19.197937 28034 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260503 07:58:19.198859 30358 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:19.199389 30358 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:58:19.199455 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 124075us
I20260503 07:58:19.199867 30358 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.202162 27957 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:19.204591 30188 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.205613 30186 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.206398 30277 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:19.215093 27960 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.176832 30197 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.225131 30186 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.225732 30188 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.227527 30186 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.227825 30188 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.227965 30277 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.232982 30203 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260503 07:58:19.229970 30329 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260503 07:58:19.232999 27999 leader_election.cc:400] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4.
I20260503 07:58:19.237502 27999 leader_election.cc:403] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:19.240947 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.241331 30287 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4.
I20260503 07:58:19.241575 28109 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:19.242489 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.243345 27954 raft_consensus.cc:2393] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 6: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:19.243391 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.244306 28109 raft_consensus.cc:2393] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 6: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:19.244956 28073 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.245725 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.246472 28073 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.248536 30346 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.249117 30346 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.249136 30266 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:19.252816 30266 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.252908 30290 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:19.253257 30266 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.253371 30290 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.258277 30346 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.258152 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.265817 30277 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.262319 30197 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.261611 30290 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.386086 30357 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:19.386917 30357 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.389394 30357 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.393844 27958 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:19.394493 30197 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.398370 30357 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.398870 30357 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:19.402691 30357 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:19.406953 27952 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.409129 28073 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.410034 30277 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:19.410403 30277 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.410835 30277 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:19.392393 30290 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.419417 30277 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.423549 30266 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.430918 30290 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:19.435756 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 162734us
I20260503 07:58:19.443601 30188 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.443878 30266 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.444181 30188 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.450181 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:19.450816 28101 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.451280 30188 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.448971 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.451623 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.452296 27959 raft_consensus.cc:2393] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 4: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
W20260503 07:58:19.449630 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 167911us
I20260503 07:58:19.449649 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.454813 27956 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 9: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:19.445317 27952 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
W20260503 07:58:19.455657 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 193098us
I20260503 07:58:19.456290 28073 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.457226 28073 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.457984 30290 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:19.458122 28073 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.458407 30290 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.458901 30290 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.459136 30228 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:19.459708 30228 raft_consensus.cc:697] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:19.452243 28108 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:19.460637 30228 consensus_queue.cc:237] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.449153 28075 leader_election.cc:400] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:19.459621 30203 raft_consensus.cc:476] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260503 07:58:19.464115 30346 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:19.467764 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.472774 30290 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.474536 30290 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.477628 30197 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:19.477768 30282 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:19.478461 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:19.478506 30266 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.478912 30282 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.479568 30266 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.480916 30282 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.481885 30282 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:19.482013 30266 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.481333 28614 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260503 07:58:19.482508 30282 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.484516 30282 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.478422 30197 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.485651 27855 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:19.486904 30197 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.487671 30282 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:19.487367 27855 catalog_manager.cc:5671] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:19.488159 30282 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.488976 27855 catalog_manager.cc:5671] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:19.490305 30282 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.433162 30358 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.495460 27957 raft_consensus.cc:2393] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 9: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.496104 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.496601 27952 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 9
W20260503 07:58:19.502452 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 44409.6us
I20260503 07:58:19.503381 27952 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:19.504245 30346 raft_consensus.cc:697] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:19.504567 30369 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.483348 28034 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 25017111886b42cfa5701a39de59b6ad (127.26.42.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } attrs { replace: true } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:19.505162 30369 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:19.505282 30346 consensus_queue.cc:237] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.509038 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.509702 28031 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:19.511201 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.511811 27952 raft_consensus.cc:2393] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.513146 30369 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.523280 30287 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.522755 28101 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:19.525593 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:19.523965 30287 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.527843 28108 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.521600 30277 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.529273 27857 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:19.537710 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.539740 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.540210 27951 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.520558 30203 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260503 07:58:19.540488 27960 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:19.541615 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.544411 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.545140 27959 raft_consensus.cc:2393] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.543540 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.545953 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.546640 27957 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.547739 27958 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:19.549446 30287 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.550253 30372 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.550813 27953 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:19.550756 30372 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.552673 30372 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.537774 30290 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.554561 30290 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.556671 30290 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.543896 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.557639 27954 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.566857 30371 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.567366 30371 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.577594 27960 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:19.569341 30290 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.614723 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.615247 27960 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.619798 27954 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.620479 27951 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:19.620774 28108 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:19.594477 30290 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:19.622067 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.622639 27955 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 8
I20260503 07:58:19.623363 27953 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:58:19.624017 30290 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:19.626978 30203 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Committing config change with OpId 6.9: config changed from index 7 to 9, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:19.609470 30277 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.630189 27955 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:19.632149 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.632680 27952 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.608249 30358 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.633234 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.636576 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:19.637125 27951 raft_consensus.cc:2393] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.633472 28617 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Committing config change with OpId 6.9: config changed from index 7 to 9, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:19.638514 30371 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.638661 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.639503 27953 raft_consensus.cc:2393] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.640604 28101 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.641602 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:19.642163 28102 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:19.647146 28101 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:19.649991 28102 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:19.657780 30277 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.651125 27960 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:19.653342 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:19.654520 28103 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260503 07:58:19.655983 28105 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:19.657212 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.660497 28100 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:19.657593 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.661201 30277 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.661527 28109 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:19.662593 28108 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.658421 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.663517 30287 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.663973 30188 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.664440 30186 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.658103 27952 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:19.668378 28104 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:19.676162 30188 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.677937 30188 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.679484 30287 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.681468 30287 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.681945 30186 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.683833 30186 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.690951 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.691605 28104 raft_consensus.cc:2368] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.696839 27856 catalog_manager.cc:5671] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:19.704170 28108 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:19.706344 27856 catalog_manager.cc:5671] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:19.709462 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.710100 28104 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:19.725351 28108 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260503 07:58:19.726980 30186 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.730981 30379 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.727528 30186 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.734419 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.735234 28108 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:19.736321 27955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:19.737001 27955 raft_consensus.cc:606] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:19.737980 27854 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 7 to 9, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:19.738626 30186 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.751626 28104 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260503 07:58:19.753566 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.753872 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.754205 28108 raft_consensus.cc:2368] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
I20260503 07:58:19.754514 28100 raft_consensus.cc:2368] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10.
I20260503 07:58:19.755287 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.755963 28105 raft_consensus.cc:2368] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.755843 30379 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.757081 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.757719 28100 raft_consensus.cc:2368] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9.
I20260503 07:58:19.758320 30379 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.765746 28104 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260503 07:58:19.768007 28614 consensus_queue.cc:237] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:19.775470 27955 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:19.775625 28031 raft_consensus.cc:1275] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:19.777829 30327 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:19.778995 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.779564 28031 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:19.779598 30327 consensus_queue.cc:1048] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:19.780673 30188 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.781056 28028 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:19.781239 30188 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.783349 30188 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.787899 28104 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:19.789669 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.790279 28034 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:19.783420 30358 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.791005 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.785162 27856 catalog_manager.cc:5671] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 6, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:19.791273 30358 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.791751 28030 raft_consensus.cc:2368] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
I20260503 07:58:19.793169 30358 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.794376 28029 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260503 07:58:19.795467 27856 catalog_manager.cc:5671] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 7 to 9, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 9 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:19.797899 28031 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:19.801441 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.801532 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet 77488bc798a841d697b108fb23d5531b with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260503 07:58:19.801915 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.803076 28026 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:19.804136 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.804780 28030 raft_consensus.cc:2368] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.805493 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:19.806150 28104 raft_consensus.cc:2393] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:19.807621 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.807797 28027 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:19.808126 28583 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:19.808249 27952 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:19.809180 27924 leader_election.cc:400] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.809500 27924 leader_election.cc:403] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:19.810148 27924 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.810230 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:19.810928 28100 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:19.809346 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.812093 27960 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.810364 27951 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:19.814740 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.815227 27960 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:19.816910 28073 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.817726 28073 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.818253 30197 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.818547 30358 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:19.818930 30358 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.819283 30358 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.818948 30197 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260503 07:58:19.819723 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.820425 28026 raft_consensus.cc:2368] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9.
I20260503 07:58:19.820858 28030 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:19.821355 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.821614 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.821770 28031 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260503 07:58:19.821877 28034 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:19.822376 28028 raft_consensus.cc:2368] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.822620 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.822664 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.823184 27951 raft_consensus.cc:1275] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:19.823457 27955 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.823333 28032 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:19.823693 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.824225 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:19.824326 28033 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:19.824734 27952 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 3.
I20260503 07:58:19.824820 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.825479 28032 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.828030 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.828260 30346 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:19.828554 28027 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.828673 30346 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:19.829164 30346 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.829327 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.829985 28030 raft_consensus.cc:2393] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.831720 28109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:19.831779 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.832358 28109 raft_consensus.cc:606] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:19.832434 28030 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.832758 28109 raft_consensus.cc:614] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:19.833371 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.833940 28028 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:19.834682 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.835144 28028 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:19.836957 30203 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260503 07:58:19.839620 28073 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.840073 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.843385 28027 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:19.844094 28073 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.844316 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.844902 28027 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.845220 28030 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.847474 27924 leader_election.cc:400] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
I20260503 07:58:19.845818 30377 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:19.848408 30377 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.848755 30377 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.849079 30371 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:19.849570 30371 raft_consensus.cc:697] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:19.850281 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.849725 30369 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:19.850373 30371 consensus_queue.cc:237] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.850942 28034 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:19.853144 30192 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:19.853520 30192 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:19.853853 30192 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.855644 30377 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.857491 28034 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:19.846155 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.846274 28033 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260503 07:58:19.835448 30358 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.864606 28026 raft_consensus.cc:2393] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:19.846495 30277 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:19.846681 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.847792 27924 leader_election.cc:403] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:19.866618 28028 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:19.866775 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.865195 28073 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.867298 28027 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.867805 28073 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.868462 28073 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.866389 30277 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.870054 30277 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:19.870256 30374 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:19.870816 30374 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:19.871713 30374 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.873083 30372 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:19.873334 30290 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:19.873456 30372 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.873834 30290 raft_consensus.cc:697] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:19.874893 27924 leader_election.cc:400] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10.
I20260503 07:58:19.874655 30290 consensus_queue.cc:237] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.875211 27924 leader_election.cc:403] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:19.875995 30197 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
I20260503 07:58:19.876154 27924 leader_election.cc:400] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.876462 27924 leader_election.cc:403] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:19.876595 30197 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 10
I20260503 07:58:19.877259 30226 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:19.873867 30372 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:19.879735 27924 leader_election.cc:400] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9.
I20260503 07:58:19.880263 27924 leader_election.cc:403] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:19.880704 30226 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:19.881093 30272 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9.
I20260503 07:58:19.881191 30226 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.883198 30226 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.883687 30226 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:19.885165 30357 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:19.887734 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet fd5660140f2a4a67bee640fa37b03a74 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:58:19.892006 30197 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10.
I20260503 07:58:19.894416 30346 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:19.897029 27857 catalog_manager.cc:5671] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New cstate: current_term: 4 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:19.905445 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:19.905747 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 97671.5us
I20260503 07:58:19.906136 28034 raft_consensus.cc:2393] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.897634 30358 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.898809 30377 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:19.904194 28073 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.914047 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.914546 28028 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.922794 30266 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:19.923156 30266 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.923485 30266 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:19.924280 30192 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:19.925086 30228 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:19.927345 28032 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:19.930475 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.930989 28033 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.938381 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:19.946503 28614 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:19.951237 28073 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.952847 28073 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.954617 28030 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:19.954624 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.955456 27952 raft_consensus.cc:2393] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:19.954269 28027 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:19.956486 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.956660 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.957818 28034 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:19.958169 28029 raft_consensus.cc:1275] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:19.957198 28033 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:19.959025 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.963861 28026 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:19.969213 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.969796 28032 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:19.956772 30374 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:19.979739 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:19.983137 28028 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:19.983258 27952 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.955165 30228 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:19.981046 28073 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.939180 30377 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260503 07:58:19.973387 30290 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:19.985848 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:19.986306 27924 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:19.989427 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:19.989956 28031 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 6
I20260503 07:58:19.987134 28034 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:19.987449 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:19.988246 27951 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:19.989262 28033 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:19.977221 30192 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:19.982966 30374 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:19.999585 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:20.000466 28032 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:20.004336 28027 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:20.001387 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:20.004958 28030 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 2.
I20260503 07:58:19.989552 30290 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:20.019004 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.019551 28108 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:20.017685 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:20.022408 28033 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 9
I20260503 07:58:19.998298 30358 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:20.031834 30372 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.017530 30290 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:20.039078 28031 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:20.040920 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.042344 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.054935 27954 raft_consensus.cc:2368] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:20.043057 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.006031 30374 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:20.058706 27952 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:19.991919 30228 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.089299 27854 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
W20260503 07:58:20.092141 30383 log.cc:927] Time spent T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.055s user 0.000s sys 0.001s
I20260503 07:58:20.087832 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.093242 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.033540 30358 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:20.127672 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.128499 27960 raft_consensus.cc:2393] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:20.091421 27854 catalog_manager.cc:5671] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:20.109413 27953 raft_consensus.cc:2393] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:20.047904 30197 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:20.086373 28027 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:20.138137 27952 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:20.138957 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.140676 27960 raft_consensus.cc:2393] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:20.130492 27854 catalog_manager.cc:5671] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:20.144816 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.127826 30358 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:20.123781 30346 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.150981 27951 raft_consensus.cc:2393] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 3: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:20.135977 30197 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.175074 30377 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:20.175344 30197 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:20.183837 30203 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:20.184434 30203 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.187706 30203 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:20.152542 27924 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:20.191481 30226 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:20.191869 30226 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:20.191614 30377 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:20.192195 30226 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:20.193154 28105 raft_consensus.cc:2955] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Committing config change with OpId 6.9: config changed from index 7 to 9, VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:20.194325 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:20.194960 27951 raft_consensus.cc:2368] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7.
I20260503 07:58:20.154191 30372 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.161252 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.161734 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.162950 30228 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.162926 28027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28731014d42b4316af0150b0e98f6152"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:20.166992 30384 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:20.169965 30277 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.223340 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.223835 30277 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.224519 28102 raft_consensus.cc:2368] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:20.193715 30266 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.228396 28106 raft_consensus.cc:2368] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
I20260503 07:58:20.234221 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:20.234728 28105 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:20.240124 28105 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:20.241446 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.214928 28027 raft_consensus.cc:606] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:20.242264 27955 raft_consensus.cc:2955] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:20.199928 28033 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
W20260503 07:58:20.201133 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 48665.7us
I20260503 07:58:20.221283 30228 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:20.249114 27926 leader_election.cc:400] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
I20260503 07:58:20.250602 27926 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:20.251849 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.252714 30355 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:20.253635 28105 raft_consensus.cc:2368] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:20.254531 30355 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:20.254918 30355 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:20.255252 30355 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:20.221444 28073 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:20.256994 28021 tablet_service.cc:1558] Processing DeleteTablet for tablet 77488bc798a841d697b108fb23d5531b with delete_type TABLET_DATA_TOMBSTONED (TS adaf84b6ac60420ab03d39b9db9f0413 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:33286
I20260503 07:58:20.198724 28104 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:20.239938 30384 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:20.253618 30197 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:20.273658 30371 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:20.274621 28033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:20.275146 28033 raft_consensus.cc:606] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:20.275449 28033 raft_consensus.cc:614] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:20.252561 28098 tablet_service.cc:1558] Processing DeleteTablet for tablet fd5660140f2a4a67bee640fa37b03a74 with delete_type TABLET_DATA_TOMBSTONED (TS be26cebb7c90445ea9a74f66463457c1 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43212
I20260503 07:58:20.243595 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.280270 28102 raft_consensus.cc:2393] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:20.257871 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:20.258116 28073 leader_election.cc:400] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7.
I20260503 07:58:20.281096 28073 leader_election.cc:403] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260503 07:58:20.236581 30290 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.257683 30228 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:20.243753 30203 raft_consensus.cc:993] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:20.299564 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:20.338869 27952 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:20.193725 30377 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:20.339067 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.280140 30371 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:20.341042 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:20.342063 28104 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:20.307474 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.313338 30277 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7.
I20260503 07:58:20.284032 30266 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.304726 30389 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:20.337700 27924 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:20.304265 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:20.339732 28102 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:20.341042 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:20.345566 27951 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:20.347012 30389 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.347465 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:20.349053 30357 raft_consensus.cc:1081] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
W20260503 07:58:20.307292 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 55292.1us
W20260503 07:58:20.350128 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 77034.3us
I20260503 07:58:20.350665 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:20.350853 28075 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:20.351828 28107 raft_consensus.cc:2368] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4.
I20260503 07:58:20.351925 30186 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:20.355559 27951 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:20.357746 28583 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:20.358886 27951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "25017111886b42cfa5701a39de59b6ad"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:20.350991 30355 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:20.359606 27951 raft_consensus.cc:606] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Received request to transfer leadership to TS 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:20.362746 27952 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:20.338143 30228 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:20.343111 30371 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:20.342476 30379 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:20.372453 30399 tablet_replica.cc:333] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: stopping tablet replica
I20260503 07:58:20.355095 30358 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.373493 30399 raft_consensus.cc:2243] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260503 07:58:20.373785 27959 raft_consensus.cc:2368] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
I20260503 07:58:20.374145 30399 pending_rounds.cc:70] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Trying to abort 1 pending ops.
I20260503 07:58:20.374404 30399 pending_rounds.cc:77] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Aborting op as it isn't in flight: id { term: 6 index: 8 } timestamp: 7281848721636827136 op_type: NO_OP noop_request { }
I20260503 07:58:20.374748 30399 raft_consensus.cc:2889] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260503 07:58:20.375087 30399 raft_consensus.cc:2272] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260503 07:58:20.376091 30358 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:20.371359 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 120821us
I20260503 07:58:20.377108 27926 leader_election.cc:400] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:20.377868 30399 ts_tablet_manager.cc:1916] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:20.378212 30379 raft_consensus.cc:697] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:20.363977 30327 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:20.362668 30272 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:20.411823 28073 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:20.418155 30226 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.364398 30266 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:20.420781 30405 tablet_replica.cc:333] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: stopping tablet replica
I20260503 07:58:20.382609 30379 consensus_queue.cc:237] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.421546 30327 raft_consensus.cc:697] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
W20260503 07:58:20.431946 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 79716.2us
I20260503 07:58:20.433171 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:20.484169 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 51088us
W20260503 07:58:20.484164 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 102052us
I20260503 07:58:20.489337 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:20.429811 30186 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:20.439491 30272 raft_consensus.cc:697] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:20.495244 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:20.495924 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 72416.3us
I20260503 07:58:20.421818 30374 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.500550 27926 leader_election.cc:400] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9.
I20260503 07:58:20.484217 30203 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:20.503894 27926 leader_election.cc:400] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:20.504843 27926 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:20.506585 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.507534 27952 raft_consensus.cc:2393] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:20.509850 28101 raft_consensus.cc:2368] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
I20260503 07:58:20.497473 30287 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:20.513317 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.521697 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:20.503383 30384 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:20.509698 30358 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:20.529237 30404 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260503 07:58:20.530426 30391 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:20.530939 30391 raft_consensus.cc:697] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:20.531855 30391 consensus_queue.cc:237] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.537631 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260503 07:58:20.538475 30400 log.cc:927] Time spent T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260503 07:58:20.525686 30290 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.517699 30203 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:20.526499 30266 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260503 07:58:20.541467 30272 consensus_queue.cc:237] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.541342 30382 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:20.506727 30282 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260503 07:58:20.662621 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 139367us
I20260503 07:58:20.679384 30186 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.497997 30327 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:20.508702 30197 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260503 07:58:20.498035 30228 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.537081 30398 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
W20260503 07:58:20.709775 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 289782us
I20260503 07:58:20.743762 28073 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:20.711882 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 190237us
I20260503 07:58:20.713951 30358 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:20.730773 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:20.704990 30287 raft_consensus.cc:697] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:20.727576 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:20.712515 30355 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:20.744629 27999 leader_election.cc:400] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:20.750761 27999 leader_election.cc:403] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:20.759912 30371 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:20.761176 30290 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:20.761466 30287 consensus_queue.cc:237] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:20.765949 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 334707us
I20260503 07:58:20.730230 30226 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:20.771390 27924 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:20.777402 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:20.815264 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 48872.5us
I20260503 07:58:20.815519 30355 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:20.779781 27924 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:20.833614 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 53922.9us
I20260503 07:58:20.751127 30382 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:20.751264 30374 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.750396 30377 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election won for term 8
W20260503 07:58:20.826354 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 47516us
I20260503 07:58:20.817109 30290 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:20.822894 30404 raft_consensus.cc:993] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:20.767398 30389 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.825420 30358 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.833415 30355 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:20.844666 30357 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:20.872253 30411 raft_consensus.cc:1081] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:20.849658 30277 consensus_queue.cc:1048] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260503 07:58:20.864244 30355 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:20.864974 30357 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:20.865325 30377 raft_consensus.cc:697] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:20.861246 30415 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260503 07:58:20.884405 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:20.884326 30401 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:20.900573 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:20.901343 27952 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:20.891607 30357 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:20.901360 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 156817us
I20260503 07:58:20.907164 27959 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:20.905696 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:20.908133 27960 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:20.911334 30186 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:20.911906 27999 leader_election.cc:400] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
I20260503 07:58:20.912186 27999 leader_election.cc:403] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:20.914012 27951 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:20.913913 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:20.912673 30188 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 7
W20260503 07:58:20.919353 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 60844.2us
I20260503 07:58:20.921334 28583 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:20.924238 30392 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:20.925091 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:20.928191 30377 consensus_queue.cc:237] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.928907 27960 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:20.933091 30357 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.935108 30357 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:20.938241 27952 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:20.901854 30413 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:20.941322 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:20.941905 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:20.942365 28108 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:20.942307 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:20.942986 28109 raft_consensus.cc:2393] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:20.946252 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:20.951015 30405 raft_consensus.cc:2243] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260503 07:58:20.933229 30375 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:20.953521 27956 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:20.954057 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:20.956583 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:20.957342 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:20.957947 28100 raft_consensus.cc:2393] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 7: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:20.957628 27952 raft_consensus.cc:2393] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:20.953075 30375 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:20.963198 30375 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:20.936290 30203 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:20.936694 30411 raft_consensus.cc:2764] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260503 07:58:20.936131 30371 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:20.920426 30402 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:20.970340 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:20.973960 27951 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:20.978818 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:20.982187 28073 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:20.985849 28073 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:20.968461 30404 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:20.897629 30382 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:21.033700 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 54974.7us
I20260503 07:58:21.034571 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:20.955399 30266 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260503 07:58:21.024238 30277 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:21.042094 28108 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:21.057994 30287 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:20.984450 30290 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260503 07:58:21.068172 30287 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:21.058681 30408 log.cc:927] Time spent T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.347s user 0.004s sys 0.000s
I20260503 07:58:21.091995 30287 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:20.947927 30413 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:21.068178 30393 log.cc:927] Time spent T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20260503 07:58:21.092890 30203 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:21.093461 30429 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.051318 30409 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.042989 30402 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.051080 30377 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260503 07:58:21.042598 30405 raft_consensus.cc:2272] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260503 07:58:21.101171 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 66687.5us
I20260503 07:58:21.104854 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:21.121930 28108 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:21.059223 30423 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:21.053257 30394 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.108744 27924 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:21.114823 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:21.125675 27954 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:21.043200 30411 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:21.102391 30277 raft_consensus.cc:697] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:21.109642 30404 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.135327 30404 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.136086 30430 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.137109 30421 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:21.137604 30404 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:21.087411 30415 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260503 07:58:21.138134 30413 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.123584 28073 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:21.114365 30290 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.119251 30409 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.115811 30203 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.181047 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:21.132685 30411 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:21.190304 28108 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:21.121412 30402 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.174428 30290 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.136571 30430 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:21.209501 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 77162us
I20260503 07:58:21.210798 30430 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:21.208977 30421 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:21.173172 30398 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:21.211119 27924 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:21.211910 27956 raft_consensus.cc:1240] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:21.212165 30430 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:21.212826 30430 raft_consensus.cc:697] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:21.213215 30290 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:21.211652 30421 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:21.213876 30421 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:21.213950 30430 consensus_queue.cc:237] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.221259 30435 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.187301 30379 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260503 07:58:21.221774 30435 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.223114 30379 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.223555 30379 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.195487 30412 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.225497 30379 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.225606 30412 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.227666 30412 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:21.228408 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:21.195672 30384 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.229661 30384 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.127018 30394 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:21.185218 30272 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.141937 30355 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.195917 30411 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:21.246433 30188 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
I20260503 07:58:21.246773 30409 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:21.237622 30287 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260503 07:58:21.119474 30429 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.251116 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:21.248420 30402 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.252905 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:21.253486 28614 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:21.223706 30435 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.257441 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:21.265036 27954 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:21.244297 30272 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.266269 28583 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
W20260503 07:58:21.267776 30427 log.cc:927] Time spent T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.154s user 0.001s sys 0.000s
I20260503 07:58:21.221001 30421 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.269798 27924 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:21.255021 30226 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.261931 30441 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.256673 30430 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.268653 30384 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:21.283661 30422 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.256s user 0.005s sys 0.003s
I20260503 07:58:21.285157 30404 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:21.286369 30188 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:21.287380 30355 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.272912 30329 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:21.263502 30277 consensus_queue.cc:237] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:21.290113 30428 log.cc:927] Time spent T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.258s user 0.005s sys 0.003s
I20260503 07:58:21.290483 30272 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.291720 30394 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
W20260503 07:58:21.306264 28075 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.783s (SENT) [suppressed 3 similar messages]
I20260503 07:58:21.310421 30228 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:21.305541 30188 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.300715 30423 raft_consensus.cc:697] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:21.319546 30188 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.279093 30226 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:21.315064 30404 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:21.301867 30418 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.375s user 0.000s sys 0.002s
I20260503 07:58:21.306454 30415 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.319281 30423 consensus_queue.cc:237] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.321429 30404 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.321472 30415 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.305596 30329 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.322466 30329 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:21.310218 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 189134us
I20260503 07:58:21.294183 30357 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:21.342195 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:21.343634 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:21.337715 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:21.357450 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:21.296010 30430 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.300051 30412 raft_consensus.cc:993] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower 25017111886b42cfa5701a39de59b6ad to start an election
I20260503 07:58:21.359329 30412 raft_consensus.cc:1081] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Signalling peer 25017111886b42cfa5701a39de59b6ad to start an election
I20260503 07:58:21.298274 30429 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:21.359925 30430 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.296350 30441 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.361032 27958 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:21.300949 30405 ts_tablet_manager.cc:1916] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:21.309494 30203 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:21.299842 30438 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.371066 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:21.311268 30421 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:21.368631 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 187679us
I20260503 07:58:21.373275 27924 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:21.377146 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:21.385849 27955 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:21.378048 30226 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.378463 30395 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:21.361881 30415 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:21.378834 30328 consensus_queue.cc:1059] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260503 07:58:21.379626 30186 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:21.380921 30441 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.365254 30404 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.381801 30438 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.384087 30411 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.371835 27953 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:21.362632 30357 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.417250 30357 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:21.389225 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 82989.6us
I20260503 07:58:21.406126 30186 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.414666 30399 ts_tablet_manager.cc:1929] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.8
I20260503 07:58:21.419271 30399 log.cc:1199] T 77488bc798a841d697b108fb23d5531b P adaf84b6ac60420ab03d39b9db9f0413: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-1-root/wals/77488bc798a841d697b108fb23d5531b
I20260503 07:58:21.420500 30399 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33286 (request call id 486) took 1170 ms. Trace:
I20260503 07:58:21.388598 30395 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:21.416769 30438 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.388135 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:21.421424 30395 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:21.406260 30226 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:21.459544 30329 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.469792 30329 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:21.433909 30188 raft_consensus.cc:2764] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260503 07:58:21.433835 28621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb"
dest_uuid: "25017111886b42cfa5701a39de59b6ad"
from {username='slave'} at 127.0.0.1:51194
I20260503 07:58:21.422895 30404 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.471011 28621 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:21.471426 28621 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:21.472378 30404 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.474582 27855 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:21.475843 27855 catalog_manager.cc:5671] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:21.464773 30357 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.467471 30411 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.477866 28621 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.420915 30399 rpcz_store.cc:276] 0503 07:58:20.249864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:20.256707 (+ 6843us) service_pool.cc:224] Handling call
0503 07:58:20.372037 (+115330us) ts_tablet_manager.cc:1151] Deleting tablet 77488bc798a841d697b108fb23d5531b
0503 07:58:20.372135 (+ 98us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:58:21.095551 (+723416us) tablet_metadata.cc:665] Metadata flushed
0503 07:58:21.414534 (+318983us) tablet_metadata.cc:665] Metadata flushed
0503 07:58:21.420382 (+ 5848us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":114478,"thread_start_us":99105,"threads_started":1}
I20260503 07:58:21.482054 28621 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.483548 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:21.493748 30437 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.215s user 0.004s sys 0.000s
W20260503 07:58:21.497596 30419 log.cc:927] Time spent T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.562s user 0.004s sys 0.009s
I20260503 07:58:21.499221 30395 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.518463 30405 ts_tablet_manager.cc:1929] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260503 07:58:21.518975 30405 log.cc:1199] T fd5660140f2a4a67bee640fa37b03a74 P be26cebb7c90445ea9a74f66463457c1: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-2-root/wals/fd5660140f2a4a67bee640fa37b03a74
I20260503 07:58:21.520246 30405 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43212 (request call id 674) took 1291 ms. Trace:
I20260503 07:58:21.520629 30405 rpcz_store.cc:276] 0503 07:58:20.228458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:20.252270 (+ 23812us) service_pool.cc:224] Handling call
0503 07:58:20.418549 (+166279us) ts_tablet_manager.cc:1151] Deleting tablet fd5660140f2a4a67bee640fa37b03a74
0503 07:58:20.418608 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:58:21.473634 (+1055026us) tablet_metadata.cc:665] Metadata flushed
0503 07:58:21.518309 (+ 44675us) tablet_metadata.cc:665] Metadata flushed
0503 07:58:21.520161 (+ 1852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":431639,"tablet-delete.queue_time_us":130644,"thread_start_us":96296,"threads_started":1}
I20260503 07:58:21.538190 30186 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:21.539162 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:21.540494 30357 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:21.542750 30395 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:21.544088 30384 raft_consensus.cc:3055] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:21.544526 30384 raft_consensus.cc:740] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:21.545692 30384 consensus_queue.cc:260] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.547387 30384 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:21.568014 27854 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 6 to 7, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 7 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:21.562914 27856 catalog_manager.cc:5671] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:21.571405 27856 catalog_manager.cc:5671] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:21.579277 27856 catalog_manager.cc:5671] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:21.579939 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:21.581486 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 208149us
I20260503 07:58:21.583078 27999 leader_election.cc:400] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:21.583449 27999 leader_election.cc:403] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:21.583809 28073 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:21.584236 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:21.590659 27999 leader_election.cc:400] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
I20260503 07:58:21.592492 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:21.592417 30374 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260503 07:58:21.593856 30226 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:21.593142 27953 raft_consensus.cc:3055] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:21.595053 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:21.595357 27953 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:21.595885 27952 raft_consensus.cc:2393] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:21.597414 27999 leader_election.cc:400] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:21.597659 27999 leader_election.cc:403] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:21.599040 28585 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:21.600318 30192 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.600831 30192 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.602656 30192 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:21.603157 30411 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 8
I20260503 07:58:21.603504 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:21.604370 28621 raft_consensus.cc:2393] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 6: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:21.606901 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:21.608698 27999 leader_election.cc:400] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4.
I20260503 07:58:21.608979 27999 leader_election.cc:403] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:21.611227 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:21.595875 30382 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:21.635833 30396 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:21.636320 30396 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.625810 30377 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.638859 30377 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.615482 28583 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:21.617049 27999 leader_election.cc:400] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
I20260503 07:58:21.617941 28073 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:21.613108 30329 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:21.596511 30186 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 8
I20260503 07:58:21.618542 30228 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:21.622258 27842 catalog_manager.cc:5002] TS be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643): tablet fd5660140f2a4a67bee640fa37b03a74 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:58:21.607615 30421 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:21.594764 30226 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:21.632817 30410 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 2 FOLLOWER]: Advancing to term 4
I20260503 07:58:21.608393 27953 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:21.651333 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:21.651923 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:21.652658 28105 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:21.642124 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:21.607515 30358 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:21.651213 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:21.647348 27999 leader_election.cc:403] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:21.652119 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:21.643200 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:21.615312 30401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s user 0.000s sys 0.031s
I20260503 07:58:22.073343 28100 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:22.077471 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:22.078059 28100 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:21.691504 28103 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:21.672176 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:21.672544 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.073993 28109 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:21.655233 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:22.074857 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 457945us
I20260503 07:58:22.080508 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:21.730762 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:22.014156 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 374551us
I20260503 07:58:21.648130 30392 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:22.079315 27954 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:22.081066 28027 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:22.084367 28027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:22.085083 28027 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:22.085358 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:22.085541 28027 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:22.087100 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:21.647933 30277 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:21.785313 30329 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:58:21.749161 30416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s user 0.033s sys 0.020s
I20260503 07:58:21.647936 30438 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:21.647763 30228 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:22.113404 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:22.113538 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.065038 30410 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 3. Current term is 4.
I20260503 07:58:22.014405 30459 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:22.076573 30401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s user 0.014s sys 0.054s
I20260503 07:58:22.154737 28109 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:22.118001 28028 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:22.099948 30277 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:58:22.118693 30416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.187s user 0.043s sys 0.022s
I20260503 07:58:21.827775 30186 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:22.118561 28107 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:21.846153 30377 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:22.093137 30384 consensus_meta.cc:287] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Time spent flushing consensus metadata: real 0.541s user 0.012s sys 0.000s
I20260503 07:58:22.138012 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:22.095845 30457 log.cc:927] Time spent T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.390s user 0.002s sys 0.002s
I20260503 07:58:22.174364 28026 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:22.113076 30404 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 7
I20260503 07:58:22.014575 30411 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:22.158716 27952 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260503 07:58:22.162118 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:22.144802 30272 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:22.164939 27960 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:22.161540 28027 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.164440 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.171263 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:22.226833 27955 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:21.680928 30358 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.226378 28035 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
W20260503 07:58:22.227926 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 65903.3us
I20260503 07:58:22.147022 30228 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:22.157584 30357 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:22.156615 30401 raft_consensus.cc:697] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:22.160509 30282 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:22.235829 28027 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:22.167155 30277 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:22.240271 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.166625 30346 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:22.118927 30329 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:22.167506 30415 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:22.154888 30438 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.213477 30396 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:22.161605 30459 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.259909 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:22.275810 27954 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:22.233983 30377 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:22.244127 30197 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:22.263952 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:22.244097 30374 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:22.271031 28026 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:22.264372 30346 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.272330 30438 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:22.273816 30329 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:22.291718 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.273604 30401 consensus_queue.cc:237] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.266366 30415 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:22.275027 28028 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:22.276767 28100 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:22.275130 30358 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:22.285638 27955 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 11.
I20260503 07:58:22.238157 30272 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.291874 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.302754 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.251780 30357 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.304105 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:22.293766 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 144906us
I20260503 07:58:22.287487 30197 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:22.298513 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:22.307315 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.308058 28026 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:22.312633 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.313707 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.314155 30459 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:22.314683 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.315649 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:22.316156 28028 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:22.291011 30374 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.322831 28028 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:22.323026 30374 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:22.324033 30462 log.cc:927] Time spent T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.112s user 0.000s sys 0.000s
I20260503 07:58:22.336457 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.337049 28028 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:22.336984 28027 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:22.349632 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:22.352387 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:22.352435 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.266830 30282 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.353427 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.288388 30377 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.351281 28583 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:22.358642 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.360468 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.335614 30197 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:22.371980 30329 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:22.373180 30357 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:22.423030 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.430032 28107 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:22.437233 30277 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:22.438634 28104 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 7: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:58:22.471607 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 215999us
I20260503 07:58:22.467077 28026 raft_consensus.cc:1275] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:22.476795 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:22.838564 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.445714 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:22.471913 28100 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260503 07:58:22.840312 28106 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260503 07:58:22.724292 27844 catalog_manager.cc:5002] TS adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): tablet 77488bc798a841d697b108fb23d5531b (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
W20260503 07:58:22.506409 30469 log.cc:927] Time spent T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260503 07:58:22.899001 27951 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260503 07:58:22.899066 28105 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260503 07:58:22.874579 27844 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 150420us
W20260503 07:58:22.740305 30421 consensus_meta.cc:287] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 1.090s user 0.005s sys 0.005s
I20260503 07:58:22.383941 30329 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:22.838246 30471 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:22.909076 28106 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:22.723803 30466 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:22.427007 30458 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:22.910969 27924 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:22.870959 27958 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:22.837977 30374 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:22.643167 30459 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:22.502954 30272 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:22.873993 27959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28731014d42b4316af0150b0e98f6152"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:22.913457 27959 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:22.913805 27959 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:22.660771 30468 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:22.916342 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.865792 30277 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:22.917128 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:22.918286 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:22.919183 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:22.920100 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:22.920652 27957 raft_consensus.cc:2368] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:22.921216 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:22.921941 28108 raft_consensus.cc:2368] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:58:22.923141 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:22.909731 30465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s user 0.015s sys 0.014s
I20260503 07:58:22.924750 28105 raft_consensus.cc:2368] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:22.897924 30282 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:22.915355 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.451735 30228 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.926980 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:22.910889 30421 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:22.912992 30458 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.913563 30471 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.916363 30459 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.900219 30415 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:22.922530 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:22.908033 30329 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:22.924718 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:22.913061 30417 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:22.914482 30466 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:22.939828 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:22.975459 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:22.947638 28075 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.584s user 0.022s sys 0.020s
I20260503 07:58:22.949602 28109 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260503 07:58:22.975965 28075 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.613s user 0.022s sys 0.020s
I20260503 07:58:22.952545 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:22.938263 30465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s user 0.016s sys 0.014s
I20260503 07:58:22.915486 30374 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:22.973697 28102 raft_consensus.cc:2393] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:58:22.974323 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 51889.5us
I20260503 07:58:22.977315 28035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
W20260503 07:58:22.976269 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 613201us
I20260503 07:58:22.977803 28035 raft_consensus.cc:606] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
W20260503 07:58:22.971261 30226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s user 0.006s sys 0.058s
I20260503 07:58:22.980635 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:22.983295 28103 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:22.925475 30468 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:22.996182 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:22.979467 30404 consensus_meta.cc:287] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.801s user 0.008s sys 0.002s
I20260503 07:58:22.998927 27926 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:22.998658 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:22.982887 30226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s user 0.006s sys 0.058s
I20260503 07:58:23.006573 27954 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260503 07:58:23.007269 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.009255 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:23.009853 27958 raft_consensus.cc:3055] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:23.010156 27958 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:22.981231 30474 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:23.013754 30468 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.014031 30459 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.014145 28104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43228 (request call id 1466) took 1369 ms. Trace:
I20260503 07:58:23.016208 28108 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:23.012933 27926 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:23.013080 28031 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:22.999835 30277 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.019547 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.023904 27951 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:22.985132 30472 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260503 07:58:23.016172 28104 rpcz_store.cc:276] 0503 07:58:21.644281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:21.644549 (+ 268us) service_pool.cc:224] Handling call
0503 07:58:23.013963 (+1369414us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000483d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:23.014073 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838765440}
I20260503 07:58:23.026453 27957 raft_consensus.cc:2410] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260503 07:58:23.001555 30404 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7.
W20260503 07:58:23.023968 27952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.004s sys 0.019s
W20260503 07:58:23.032299 27952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s user 0.005s sys 0.019s
I20260503 07:58:23.027143 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:23.034477 28614 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:22.998639 30415 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:23.030965 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:23.018198 30478 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.039179 27952 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:23.025556 27958 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.040827 28035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:23.020565 30226 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:23.018560 30474 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:23.023685 30458 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.026023 30446 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:23.045686 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.030095 30228 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.024545 30477 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:23.036854 30357 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:23.053426 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:23.055059 30401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s user 0.000s sys 0.007s
I20260503 07:58:23.052124 28103 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:23.027114 30277 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.057516 30466 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:23.085726 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 51283.3us
I20260503 07:58:23.071130 28102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43228 (request call id 1467) took 1426 ms. Trace:
I20260503 07:58:23.052482 30226 raft_consensus.cc:697] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:23.045190 30474 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:23.072165 27959 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.073264 28100 raft_consensus.cc:1240] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:23.095275 27957 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 7. Ops: []
W20260503 07:58:23.063166 30401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s user 0.000s sys 0.008s
I20260503 07:58:23.082055 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.083314 27924 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:23.085126 27953 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:23.099990 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 50734.5us
I20260503 07:58:23.086804 28102 rpcz_store.cc:276] 0503 07:58:21.646849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:21.672307 (+ 25458us) service_pool.cc:224] Handling call
0503 07:58:23.070946 (+1398639us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b5400049cd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:23.071072 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2056435584}
I20260503 07:58:23.049273 30478 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.081147 30228 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.105568 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:23.086520 27926 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:23.048787 30282 consensus_queue.cc:1059] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260503 07:58:23.093667 27951 raft_consensus.cc:1275] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:23.040701 30415 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.102239 27959 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:23.103102 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 68548.5us
I20260503 07:58:23.122920 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:23.126753 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.127090 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.127791 28101 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:23.128662 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.087792 30346 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.138827 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:23.124752 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.140501 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.135834 28035 raft_consensus.cc:606] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:23.146683 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.147409 27960 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:23.096720 30392 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.104110 30357 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:23.181258 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.180792 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.213105 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.213764 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:23.213949 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 113450us
W20260503 07:58:23.214031 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 102017us
I20260503 07:58:23.214859 28583 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:23.218968 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.219976 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.220846 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.181620 30472 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 07:58:23.221122 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 47008.2us
I20260503 07:58:23.059464 30477 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.222769 30478 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.223126 30477 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:23.223294 30465 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.161s user 0.000s sys 0.001s
I20260503 07:58:23.221464 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:23.153252 30480 log.cc:927] Time spent T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.134s user 0.000s sys 0.001s
I20260503 07:58:23.224327 27959 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
W20260503 07:58:23.225322 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 75603.1us
I20260503 07:58:23.227201 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:23.227777 28101 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:23.138280 30458 raft_consensus.cc:2749] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:23.141247 30459 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:23.103826 30446 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260503 07:58:23.238502 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:23.181071 30421 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:23.232220 28029 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:23.235118 27959 raft_consensus.cc:1275] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:23.122061 30228 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.181035 30489 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:23.315361 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:23.340756 28617 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:23.224280 30471 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:23.340888 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 105267us
I20260503 07:58:23.342290 28101 raft_consensus.cc:1275] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260503 07:58:23.345991 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.241415 30397 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:23.348332 28102 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:23.236056 30477 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:23.234189 30493 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.349695 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.241842 30277 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.351496 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.348497 30397 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:23.357488 30397 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:23.343912 30489 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.241698 30357 raft_consensus.cc:697] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:23.356866 28617 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:23.231948 30425 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260503 07:58:23.341709 30377 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:23.348037 30484 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.335s user 0.001s sys 0.000s
I20260503 07:58:23.212282 30392 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:23.376067 28075 leader_election.cc:336] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.518s (SENT)
I20260503 07:58:23.378789 28075 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:23.295771 30472 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.361871 30477 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.370791 30357 consensus_queue.cc:237] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:23.372125 30486 log.cc:927] Time spent T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.271s user 0.000s sys 0.000s
W20260503 07:58:23.351008 30470 log.cc:927] Time spent T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.575s user 0.001s sys 0.007s
W20260503 07:58:23.377193 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 248048us
W20260503 07:58:23.383141 28075 leader_election.cc:336] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.538s (SENT)
I20260503 07:58:23.241519 30459 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.352974 30495 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:23.401371 28075 leader_election.cc:336] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.562s (SENT)
W20260503 07:58:23.450662 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 49315.2us
W20260503 07:58:23.451749 28075 leader_election.cc:336] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.783s (SENT)
I20260503 07:58:23.452203 30474 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.455061 30474 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:23.410209 30491 log.cc:927] Time spent T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.178s user 0.000s sys 0.000s
W20260503 07:58:23.410516 30476 log.cc:927] Time spent T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.370s user 0.001s sys 0.000s
I20260503 07:58:23.412268 30477 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.362205 30493 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.346607 30421 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.343932 30226 consensus_queue.cc:237] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.414047 30401 consensus_queue.cc:1059] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260503 07:58:23.483458 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 141795us
I20260503 07:58:23.419257 30392 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.384126 30497 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260503 07:58:23.422645 30197 consensus_meta.cc:287] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.997s user 0.008s sys 0.001s
I20260503 07:58:23.424362 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.416599 30397 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.426290 27954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45176 (request call id 1578) took 1063 ms. Trace:
I20260503 07:58:23.526141 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1245) took 1443 ms. Trace:
I20260503 07:58:23.428298 30489 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:23.428433 28031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33288 (request call id 1242) took 1346 ms (client timeout 1734 ms). Trace:
I20260503 07:58:23.529917 28029 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:23.432493 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 317) took 2089 ms. Trace:
I20260503 07:58:23.433207 28027 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:23.435880 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.400517 30472 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.438553 27958 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:23.439713 27953 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:23.442452 28107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43222 (request call id 1607) took 1080 ms. Trace:
I20260503 07:58:23.550194 28107 rpcz_store.cc:276] 0503 07:58:22.361576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.361804 (+ 228us) service_pool.cc:224] Handling call
0503 07:58:22.425215 (+ 63411us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:22.430441 (+ 5226us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:23.442202 (+1011761us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b54002c79d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:23.442382 (+ 180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10140032}
I20260503 07:58:23.438606 30329 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:23.460392 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 48317.3us
W20260503 07:58:23.530800 28031 rpcz_store.cc:269] 0503 07:58:22.082119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.082232 (+ 113us) service_pool.cc:224] Handling call
0503 07:58:23.428251 (+1346019us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54002391d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:23.428354 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917986048}
I20260503 07:58:23.549599 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:23.552325 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 203445us
I20260503 07:58:23.526861 28032 rpcz_store.cc:276] 0503 07:58:22.083165 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.083260 (+ 95us) service_pool.cc:224] Handling call
0503 07:58:23.074079 (+990819us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800002498. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649a3e 000000000035a3c9 00007f85096818e0 00007f850974a784 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:58:23.074239 (+ 160us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:23.232015 (+157776us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:23.232053 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:23.236038 (+ 3985us) log.cc:844] Serialized 26 byte log entry
0503 07:58:23.454799 (+218761us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:23.455039 (+ 240us) log.cc:844] Serialized 14 byte log entry
0503 07:58:23.455222 (+ 183us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:23.455308 (+ 86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:23.483395 (+ 28087us) raft_consensus.cc:1685] finished
0503 07:58:23.525906 (+ 42511us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:23.526072 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140223,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":144210,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":3633,"spinlock_wait_cycles":2439424,"thread_start_us":103974,"threads_started":1,"wal-append.queue_time_us":110911}
I20260503 07:58:23.554235 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.418236 30459 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:23.489603 30490 log.cc:927] Time spent T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.145s user 0.001s sys 0.000s
I20260503 07:58:23.490041 30228 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.490377 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1253) took 1311 ms. Trace:
I20260503 07:58:23.490072 27956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2192) took 1332 ms. Trace:
I20260503 07:58:23.492317 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1246) took 1408 ms. Trace:
I20260503 07:58:23.494066 30493 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.496894 28030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1252) took 1317 ms. Trace:
I20260503 07:58:23.570639 28030 rpcz_store.cc:276] 0503 07:58:22.165812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.165984 (+ 172us) service_pool.cc:224] Handling call
0503 07:58:22.179265 (+ 13281us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:22.179587 (+ 322us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:22.179617 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:22.234486 (+ 54869us) log.cc:844] Serialized 26 byte log entry
0503 07:58:22.839054 (+604568us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:22.839087 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:22.839141 (+ 54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:23.459275 (+620134us) raft_consensus.cc:1685] finished
0503 07:58:23.483054 (+ 23779us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:23.483159 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":28478,"thread_start_us":157766,"threads_started":1,"wal-append.queue_time_us":767520}
I20260503 07:58:23.572539 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.573093 28030 raft_consensus.cc:2376] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6. Re-sending same reply.
I20260503 07:58:23.573832 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.574836 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.501767 30272 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:23.502889 30401 raft_consensus.cc:3055] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:23.577298 30401 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:23.577411 30421 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:23.578145 30401 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.579278 30401 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:23.516183 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:23.525461 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 75907.1us
I20260503 07:58:23.525976 27954 rpcz_store.cc:276] 0503 07:58:22.362470 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.362770 (+ 300us) service_pool.cc:224] Handling call
0503 07:58:22.367207 (+ 4437us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:23.011990 (+644783us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:23.426036 (+414046us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54001bcbd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:23.426216 (+ 180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469876992}
W20260503 07:58:23.581370 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 65253.1us
W20260503 07:58:23.530519 28028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33288 (request call id 1275) took 1192 ms (client timeout 1504 ms). Trace:
W20260503 07:58:23.582084 28028 rpcz_store.cc:269] 0503 07:58:22.337867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.337995 (+ 128us) service_pool.cc:224] Handling call
0503 07:58:23.424303 (+1086308us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5c00086f8c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f8508099671 00007f850823aad9 00007f85096f8076 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:23.530469 (+106166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29441280}
I20260503 07:58:23.583060 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.583663 30392 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:23.584196 30392 raft_consensus.cc:697] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:23.529695 28073 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:23.536329 30471 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.585297 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:23.585098 30392 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.585419 30471 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.542927 28029 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:23.555016 28026 raft_consensus.cc:2368] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7.
I20260503 07:58:23.587180 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.588042 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.588732 28617 raft_consensus.cc:1240] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:23.590474 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:23.569109 28034 rpcz_store.cc:276] 0503 07:58:22.083411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.083508 (+ 97us) service_pool.cc:224] Handling call
0503 07:58:22.083757 (+ 249us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:22.092658 (+ 8901us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:22.092680 (+ 22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:22.114201 (+ 21521us) log.cc:844] Serialized 26 byte log entry
0503 07:58:22.290949 (+176748us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:22.290987 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:22.299418 (+ 8431us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:23.080930 (+781512us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f85042bec0e 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1 00007f85042c7579 00007f85042c7509
0503 07:58:23.492075 (+411145us) raft_consensus.cc:1685] finished
0503 07:58:23.492093 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:23.492264 (+ 171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1601,"raft.run_cpu_time_us":5703,"raft.run_wall_time_us":43621,"spinlock_wait_cycles":9934592,"thread_start_us":125902,"threads_started":1,"wal-append.queue_time_us":327290}
I20260503 07:58:23.593716 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.594326 28034 raft_consensus.cc:2393] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:23.594973 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.595798 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.596648 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.560936 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:23.561188 27953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41856 (request call id 284) took 1958 ms (client timeout 2159 ms). Trace:
W20260503 07:58:23.597553 27953 rpcz_store.cc:269] 0503 07:58:21.592168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:21.592276 (+ 108us) service_pool.cc:224] Handling call
0503 07:58:23.072543 (+1480267us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b58005e8ed0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850468048a 00007f8504702827 00007f850471b3c7 00007f850471cbbe 00007f850472865c 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c
0503 07:58:23.550027 (+477484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465900928}
I20260503 07:58:23.561702 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.598555 28106 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:23.562889 30329 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.528789 30197 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.467757 30495 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.600694 30415 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.565055 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.602114 27955 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:23.602238 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.528451 30477 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260503 07:58:23.603233 30228 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.603538 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.603655 30228 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:23.604959 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 75355us
I20260503 07:58:23.605170 30501 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:23.605536 30501 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:23.555190 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:23.590234 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:23.605923 30501 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:23.531751 27855 rpcz_store.cc:276] 0503 07:58:21.343547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:21.343791 (+ 244us) service_pool.cc:224] Handling call
0503 07:58:23.432407 (+2088616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:21.727703 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:21.849178 (+121475us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:21.850046 (+ 868us) write_op.cc:435] Acquired schema lock
0503 07:58:21.864961 (+ 14915us) tablet.cc:662] Decoding operations
0503 07:58:21.887270 (+ 22309us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:21.887353 (+ 83us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:21.887391 (+ 38us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:58:21.887727 (+ 336us) tablet.cc:701] Row locks acquired
0503 07:58:21.887746 (+ 19us) write_op.cc:260] PREPARE: finished
0503 07:58:21.887897 (+ 151us) write_op.cc:270] Start()
0503 07:58:21.888030 (+ 133us) write_op.cc:276] Timestamp: P: 1777795101887850 usec, L: 0
0503 07:58:21.888055 (+ 25us) op_driver.cc:348] REPLICATION: starting
0503 07:58:21.888759 (+ 704us) log.cc:844] Serialized 917 byte log entry
0503 07:58:23.056130 (+1167371us) op_driver.cc:464] REPLICATION: finished
0503 07:58:23.359828 (+303698us) write_op.cc:301] APPLY: starting
0503 07:58:23.359915 (+ 87us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:23.360018 (+ 103us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:23.360117 (+ 99us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:23.360424 (+ 307us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:23.360577 (+ 153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:58:23.360621 (+ 44us) write_op.cc:312] APPLY: finished
0503 07:58:23.360820 (+ 199us) log.cc:844] Serialized 29 byte log entry
0503 07:58:23.360984 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:23.361077 (+ 93us) write_op.cc:454] Released schema lock
0503 07:58:23.361116 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:23.361479 (+ 363us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:23.361510 (+ 31us) write_op.cc:454] Released schema lock
0503 07:58:23.502567 (+141057us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000cf1a0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85046a2723 00007f85046a6155 00007f85046a60e9 00007f85046a6079 00007f85046a6041 00007f85046a533d 0000000000379254 0000000000379099 00007f8501686ab5 00007f8501688e01
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":291449,"apply.run_cpu_time_us":1638,"apply.run_wall_time_us":1637,"num_ops":2,"prepare.queue_time_us":126194,"prepare.run_cpu_time_us":88676,"prepare.run_wall_time_us":522294,"raft.queue_time_us":860202,"raft.run_cpu_time_us":9987,"raft.run_wall_time_us":471378,"replication_time_us":1149352,"spinlock_wait_cycles":234308480,"thread_start_us":1118728,"threads_started":4,"wal-append.queue_time_us":412920}]]}
I20260503 07:58:23.591220 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.608078 27954 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 8.
I20260503 07:58:23.565833 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.609166 28035 raft_consensus.cc:2376] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8. Re-sending same reply.
I20260503 07:58:23.567783 28033 rpcz_store.cc:276] 0503 07:58:22.179447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.179576 (+ 129us) service_pool.cc:224] Handling call
0503 07:58:22.237822 (+ 58246us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:22.254610 (+ 16788us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:22.254649 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:22.264960 (+ 10311us) log.cc:844] Serialized 26 byte log entry
0503 07:58:22.661342 (+396382us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:23.051748 (+390406us) log.cc:844] Serialized 14 byte log entry
0503 07:58:23.052050 (+ 302us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:23.052139 (+ 89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:23.486396 (+434257us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b24000123f8. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85014d8e94 00007f85014d6f9b 00007f8501565d39 00007f85015659c5 00007f8501564f20 00007f85042eb828 00007f85042ebf88 00007f85042c3738 00007f85042beb0a 00007f85042bdf56
0503 07:58:23.490123 (+ 3727us) raft_consensus.cc:1685] finished
0503 07:58:23.490205 (+ 82us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:23.490310 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32353,"prepare.queue_time_us":435181,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":2716,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":11190,"spinlock_wait_cycles":227547520,"thread_start_us":644529,"threads_started":2,"wal-append.queue_time_us":692055}
I20260503 07:58:23.610162 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.610350 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.611070 28033 raft_consensus.cc:2393] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:23.611622 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1272) took 1274 ms. Trace:
I20260503 07:58:23.589968 28614 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:23.611778 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.553313 30377 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260503 07:58:23.566787 30489 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.614409 30272 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:23.614482 30489 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.614933 30272 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:23.616051 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.617089 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.617946 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.618839 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.619613 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53082 (request call id 144) took 2053 ms. Trace:
I20260503 07:58:23.619697 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.620667 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.621665 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.623507 27955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45176 (request call id 1577) took 1261 ms. Trace:
I20260503 07:58:23.568696 27956 rpcz_store.cc:276] 0503 07:58:22.157811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.159100 (+ 1289us) service_pool.cc:224] Handling call
0503 07:58:22.159330 (+ 230us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:22.349857 (+190527us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:22.349881 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:22.366676 (+ 16795us) log.cc:844] Serialized 26 byte log entry
0503 07:58:22.840696 (+474020us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:22.840743 (+ 47us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:22.840828 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:23.489870 (+649042us) raft_consensus.cc:1685] finished
0503 07:58:23.489904 (+ 34us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:23.490020 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18600,"raft.queue_time_us":53926,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":25304,"thread_start_us":611125,"threads_started":2,"wal-append.queue_time_us":586938}
I20260503 07:58:23.646235 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.604801 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.612838 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.647337 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.647598 28028 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:23.619992 27854 rpcz_store.cc:276] 0503 07:58:21.565775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:21.565911 (+ 136us) service_pool.cc:224] Handling call
0503 07:58:23.619563 (+2053652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:22.264940 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:22.367595 (+102655us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:22.367627 (+ 32us) write_op.cc:435] Acquired schema lock
0503 07:58:22.367645 (+ 18us) tablet.cc:662] Decoding operations
0503 07:58:22.367983 (+ 338us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:22.368031 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:22.368059 (+ 28us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:58:22.368224 (+ 165us) tablet.cc:701] Row locks acquired
0503 07:58:22.368244 (+ 20us) write_op.cc:260] PREPARE: finished
0503 07:58:22.368370 (+ 126us) write_op.cc:270] Start()
0503 07:58:22.368475 (+ 105us) write_op.cc:276] Timestamp: P: 1777795102368330 usec, L: 0
0503 07:58:22.368508 (+ 33us) op_driver.cc:348] REPLICATION: starting
0503 07:58:22.369095 (+ 587us) log.cc:844] Serialized 591 byte log entry
0503 07:58:23.502796 (+1133701us) op_driver.cc:464] REPLICATION: finished
0503 07:58:23.551542 (+ 48746us) write_op.cc:301] APPLY: starting
0503 07:58:23.553578 (+ 2036us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:23.597054 (+ 43476us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:23.597146 (+ 92us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:23.597300 (+ 154us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:23.597421 (+ 121us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:58:23.597461 (+ 40us) write_op.cc:312] APPLY: finished
0503 07:58:23.597627 (+ 166us) log.cc:844] Serialized 23 byte log entry
0503 07:58:23.597778 (+ 151us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:23.597835 (+ 57us) write_op.cc:454] Released schema lock
0503 07:58:23.597867 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:23.598195 (+ 328us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:23.598220 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":10229,"apply.run_cpu_time_us":1334,"apply.run_wall_time_us":68114,"num_ops":1,"prepare.queue_time_us":680894,"prepare.run_cpu_time_us":2564,"prepare.run_wall_time_us":107204,"replication_time_us":1134178}]]}
I20260503 07:58:23.640581 30477 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:23.641279 30374 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.642481 30397 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.605633 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:23.588891 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:23.644788 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 63402.9us
W20260503 07:58:23.644738 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 76356.6us
W20260503 07:58:23.691516 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:23.611994 28027 rpcz_store.cc:276] 0503 07:58:22.337052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.353703 (+ 16651us) service_pool.cc:224] Handling call
0503 07:58:23.432843 (+1079140us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:23.532299 (+ 99456us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:23.611461 (+ 79162us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002391d0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504723c8d 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:23.611573 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481161088}
I20260503 07:58:23.648334 28031 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:23.730590 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.649000 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:23.731212 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 125671us
I20260503 07:58:23.730587 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.731624 27956 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:23.731900 28028 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:23.650040 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.647729 28033 raft_consensus.cc:2376] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9. Re-sending same reply.
I20260503 07:58:23.645817 27955 rpcz_store.cc:276] 0503 07:58:22.362219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:22.362331 (+ 112us) service_pool.cc:224] Handling call
0503 07:58:22.362614 (+ 283us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:23.602485 (+1239871us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:23.623287 (+ 20802us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400391cd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:23.623451 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850176896}
I20260503 07:58:23.655830 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:23.737557 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.738220 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.738549 28030 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:23.738984 28034 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:23.726711 28035 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:23.739358 28030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:23.742828 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.650876 27856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 313) took 2310 ms. Trace:
I20260503 07:58:23.740334 28585 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:23.725353 30277 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:23.744813 30496 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:23.744648 30277 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.744927 30346 consensus_queue.cc:1048] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:23.733942 30226 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:23.745813 30226 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.736524 30485 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.746531 30277 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:23.747071 30416 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:23.746939 30485 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.747625 30226 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.747579 30416 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.720351 30502 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:23.736608 30415 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260503 07:58:23.739478 27924 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:23.740777 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.743183 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.748991 30485 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.749346 30502 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.758898 30502 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.753196 28035 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:23.753942 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.762648 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.754781 28031 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:23.763685 27952 raft_consensus.cc:2410] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260503 07:58:23.756314 27958 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:23.765625 27999 leader_election.cc:400] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:23.766155 27999 leader_election.cc:403] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260503 07:58:23.650882 30507 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:23.742563 28030 raft_consensus.cc:606] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:23.768874 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:23.722007 30489 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.651126 30197 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.765909 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:23.686609 30394 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:23.755440 30416 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.737958 30477 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.820447 28031 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:23.771891 27956 raft_consensus.cc:2468] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:23.843024 30459 raft_consensus.cc:993] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:23.850951 30272 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.851650 30459 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:23.853156 30421 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:23.854251 30459 raft_consensus.cc:1081] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:23.826540 30507 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.858071 28026 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:23.772828 28028 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:23.686476 30495 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.687520 30472 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.734274 30471 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:23.770418 30357 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:23.877653 28031 raft_consensus.cc:1275] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260503 07:58:23.743556 27856 rpcz_store.cc:276] 0503 07:58:21.336329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:21.336484 (+ 155us) service_pool.cc:224] Handling call
0503 07:58:23.646198 (+2309714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:22.369477 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:22.369996 (+ 519us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:22.370022 (+ 26us) write_op.cc:435] Acquired schema lock
0503 07:58:22.370042 (+ 20us) tablet.cc:662] Decoding operations
0503 07:58:22.370523 (+ 481us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:22.370584 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:22.370611 (+ 27us) tablet.cc:685] Acquiring locks for 3 operations
0503 07:58:22.370911 (+ 300us) tablet.cc:701] Row locks acquired
0503 07:58:22.370923 (+ 12us) write_op.cc:260] PREPARE: finished
0503 07:58:22.371046 (+ 123us) write_op.cc:270] Start()
0503 07:58:22.371139 (+ 93us) write_op.cc:276] Timestamp: P: 1777795102371005 usec, L: 0
0503 07:58:22.371154 (+ 15us) op_driver.cc:348] REPLICATION: starting
0503 07:58:22.371642 (+ 488us) log.cc:844] Serialized 1299 byte log entry
0503 07:58:23.503267 (+1131625us) op_driver.cc:464] REPLICATION: finished
0503 07:58:23.598478 (+ 95211us) write_op.cc:301] APPLY: starting
0503 07:58:23.598539 (+ 61us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:23.598651 (+ 112us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:23.598722 (+ 71us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:23.599078 (+ 356us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:23.599219 (+ 141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0503 07:58:23.599258 (+ 39us) write_op.cc:312] APPLY: finished
0503 07:58:23.599420 (+ 162us) log.cc:844] Serialized 35 byte log entry
0503 07:58:23.599554 (+ 134us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:23.599628 (+ 74us) write_op.cc:454] Released schema lock
0503 07:58:23.599662 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":95052,"apply.run_cpu_time_us":1432,"apply.run_wall_time_us":1431,"num_ops":3,"prepare.queue_time_us":786233,"prepare.run_cpu_time_us":2342,"prepare.run_wall_time_us":2342,"replication_time_us":1132010,"thread_start_us":234768,"threads_started":1}]]}
I20260503 07:58:23.813102 30493 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:23.814714 30478 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:23.815925 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.816458 30474 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260503 07:58:23.816787 30429 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:23.655994 30504 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:23.812861 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:23.794448 28029 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260503 07:58:23.751163 30415 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 11 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:23.866210 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 100442us
I20260503 07:58:23.906064 27954 raft_consensus.cc:2410] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260503 07:58:23.868750 28583 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:23.877759 28030 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:23.852839 30272 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.750721 30228 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:23.878813 28027 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:23.745373 30382 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260503 07:58:23.883131 28028 raft_consensus.cc:1275] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:23.770447 30485 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:23.910228 28073 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:23.863045 30394 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.881644 30477 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:23.883731 30493 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:23.879347 30421 consensus_queue.cc:1059] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260503 07:58:23.882010 30377 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:23.898861 30392 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:23.920059 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 51415.7us
I20260503 07:58:24.028627 28027 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:23.884346 30357 raft_consensus.cc:697] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:24.096066 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 230042us
W20260503 07:58:24.098186 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 188020us
I20260503 07:58:23.905395 30502 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:24.102417 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:23.962952 30446 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:24.066471 30519 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Stepping down as leader of term 10
I20260503 07:58:23.905231 30429 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:23.884486 30489 consensus_queue.cc:1059] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.212s
I20260503 07:58:24.104931 30374 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260503 07:58:24.105451 30423 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:24.087167 30377 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:23.925136 30503 raft_consensus.cc:2804] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:23.959921 30507 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:23.898702 30478 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.109210 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.110687 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.111691 27924 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:24.118932 30489 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:24.119233 27924 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.119624 30429 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:24.108266 30423 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:24.120128 30429 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:24.120198 30423 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:24.120335 27924 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:24.113159 30518 log.cc:927] Time spent T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.114s user 0.003s sys 0.000s
I20260503 07:58:24.121774 30472 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:24.121886 30401 raft_consensus.cc:3055] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:24.112907 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.122345 30401 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:24.123189 30401 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.124396 30401 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:24.107023 30519 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:24.126385 30519 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.127512 30519 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:24.116343 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.117134 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.119387 30489 raft_consensus.cc:697] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:23.911886 30504 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.129309 30489 consensus_queue.cc:237] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:24.116518 30516 log.cc:927] Time spent T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.151s user 0.002s sys 0.000s
I20260503 07:58:24.111675 30377 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:24.120483 30429 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:24.102068 30421 consensus_queue.cc:1243] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260503 07:58:23.963299 30501 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.153007 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.107774 30502 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.030761 30415 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.158545 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.159550 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.160645 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.157588 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.162953 27924 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:24.118213 30503 raft_consensus.cc:697] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:24.164815 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.100369 30392 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.165668 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:24.168835 28621 raft_consensus.cc:2410] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260503 07:58:24.145268 30474 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:24.110208 30446 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.167999 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.148545 30496 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:24.148705 30429 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:24.170398 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.174239 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.171221 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.175073 28106 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 8.
I20260503 07:58:24.171749 30489 consensus_queue.cc:1059] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:24.172533 30522 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:24.169597 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:24.180482 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.162140 30421 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:24.167212 30425 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:24.165959 30477 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:24.177155 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 1970) took 1026 ms. Trace:
I20260503 07:58:24.167860 30374 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:24.164391 30404 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:24.179929 28101 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:24.204389 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:24.204775 28101 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:24.181157 27953 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:24.176612 28105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:24.205376 28105 raft_consensus.cc:606] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:24.180809 28614 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:24.172772 30523 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260503 07:58:24.202361 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.182765 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:24.183235 28031 raft_consensus.cc:3055] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:24.183430 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:24.176885 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:24.186537 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.213816 27952 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:24.189430 30392 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.192476 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:24.216099 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:24.170043 30485 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:24.154522 30197 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260503 07:58:24.196882 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.216691 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.170138 30474 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:24.173468 30394 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:24.166095 30525 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:24.213186 28031 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:24.183981 30425 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:24.214696 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:24.215840 28583 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:24.179028 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.230162 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.214771 30374 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.217775 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.216251 27959 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:24.214408 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.232956 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:24.234500 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:24.234727 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.195179 28035 rpcz_store.cc:276] 0503 07:58:23.151256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:23.760220 (+608964us) service_pool.cc:224] Handling call
0503 07:58:23.848057 (+ 87837us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:23.877218 (+ 29161us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:23.877245 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:23.882875 (+ 5630us) log.cc:844] Serialized 26 byte log entry
0503 07:58:24.154070 (+271195us) raft_consensus.cc:1645] Marking committed up to 3
0503 07:58:24.154120 (+ 50us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:24.161310 (+ 7190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:24.176370 (+ 15060us) raft_consensus.cc:1685] finished
0503 07:58:24.176382 (+ 12us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:24.177096 (+ 714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14797,"raft.queue_time_us":15602,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":16820,"thread_start_us":191195,"threads_started":1,"wal-append.queue_time_us":254182}
I20260503 07:58:24.222482 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.237718 28104 raft_consensus.cc:2393] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:24.219230 30474 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:24.227895 28101 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
W20260503 07:58:24.239322 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 66717.9us
I20260503 07:58:24.241503 30472 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:24.242177 30472 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:24.242758 30472 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
W20260503 07:58:24.222349 30529 log.cc:927] Time spent T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260503 07:58:24.244261 28103 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:24.245325 27999 leader_election.cc:400] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:58:24.260588 27999 leader_election.cc:403] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260503 07:58:24.245584 28109 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:24.244118 28031 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.261468 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.264680 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.264918 30501 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:24.265555 30404 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:24.265798 30525 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:24.265974 27999 leader_election.cc:400] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6.
I20260503 07:58:24.267637 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.268491 30525 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:24.272390 28583 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.273680 30496 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:24.277400 28583 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:24.279191 30192 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:24.279675 30192 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:24.280098 30192 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:24.291368 30525 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:24.293735 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.232529 30425 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:24.207858 30477 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.223610 30504 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.303334 27999 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.169467 30357 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.244869 30493 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.318085 28031 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:24.262102 30397 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:24.295338 30498 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:24.319612 28583 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.295141 30485 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:58:24.325141 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:24.325665 27958 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:24.326447 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:24.305889 30525 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:24.319801 30501 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:24.326926 30397 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:24.328096 30498 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:24.327772 30493 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:24.330839 30504 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:24.363940 28031 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260503 07:58:24.364437 28031 pending_rounds.cc:85] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 4
I20260503 07:58:24.364737 28031 pending_rounds.cc:107] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260503 07:58:24.365099 28031 raft_consensus.cc:2889] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:24.360957 27958 raft_consensus.cc:2468] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:24.372210 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:24.377456 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 48759.3us
I20260503 07:58:24.378095 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:24.339778 30192 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.351786 30374 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:24.352263 30397 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:24.354949 30498 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:24.340173 30485 consensus_queue.cc:1059] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260503 07:58:24.380293 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:24.243927 30503 consensus_queue.cc:237] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.334728 30539 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260503 07:58:24.375578 30404 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260503 07:58:24.395586 28073 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:24.381697 30277 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:24.377089 30478 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.353586 30501 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.380573 30493 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:24.386785 30502 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.402032 30477 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:24.406479 30528 log.cc:927] Time spent T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
I20260503 07:58:24.408270 30192 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.349035 30530 consensus_queue.cc:1059] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260503 07:58:24.416814 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:24.420130 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:24.436581 28031 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:24.437196 27951 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260503 07:58:24.400568 30524 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260503 07:58:24.429085 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.391908 30446 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.413354 30525 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260503 07:58:24.429493 30527 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.123s user 0.000s sys 0.000s
I20260503 07:58:24.436605 27960 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:24.450452 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.450944 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.451094 28026 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:24.435732 30282 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:24.442510 30374 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:24.461329 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.445747 30524 raft_consensus.cc:3055] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:24.460414 30282 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:24.517611 30534 log.cc:927] Time spent T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.118s user 0.000s sys 0.000s
I20260503 07:58:24.445670 30525 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:24.537617 30374 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.448978 30392 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260503 07:58:24.546531 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:24.732771 30519 consensus_meta.cc:287] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.605s user 0.011s sys 0.006s
I20260503 07:58:24.733542 28026 raft_consensus.cc:2410] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260503 07:58:24.727424 30524 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:24.737494 30524 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:24.738608 30524 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:24.569416 30532 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.143s user 0.001s sys 0.000s
W20260503 07:58:24.649971 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 210913us
I20260503 07:58:24.451272 30542 raft_consensus.cc:2804] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:24.718573 30226 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:24.743803 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.744323 28026 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:24.720602 30397 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:24.721433 30429 consensus_meta.cc:287] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.542s user 0.017s sys 0.028s
I20260503 07:58:24.743664 30226 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.746449 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:24.721482 30423 consensus_meta.cc:287] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.588s user 0.006s sys 0.012s
I20260503 07:58:24.722819 30504 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:24.724846 28031 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 9.
I20260503 07:58:24.452924 30493 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:24.727918 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.729413 30525 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:24.731175 30374 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:24.741859 30282 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.747795 27924 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.753103 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.765901 27960 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 9.
I20260503 07:58:24.768778 30226 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.770167 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.774459 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:24.775291 28031 raft_consensus.cc:2410] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260503 07:58:24.776301 28026 raft_consensus.cc:2393] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:24.778898 30502 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:24.720844 30498 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.782079 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.764465 30197 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:24.784050 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:24.782624 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 45100.8us
I20260503 07:58:24.789148 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:24.793865 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.794412 28026 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:24.802186 27960 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:24.802304 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.803287 27956 raft_consensus.cc:2368] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9.
I20260503 07:58:24.763437 30429 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.799340 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:24.812851 27955 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:24.813270 28075 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:24.764251 30423 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.819134 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.766786 30425 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.824100 27951 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:24.824158 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.825266 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.790771 30197 raft_consensus.cc:697] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:24.827616 30226 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:24.828028 30226 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:24.828437 30226 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:24.830227 27926 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:24.837173 30357 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:24.837891 30357 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:24.838997 30357 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:24.839334 28585 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:24.841882 30374 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:24.842425 30374 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.842761 30519 consensus_queue.cc:1059] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:24.843689 30401 raft_consensus.cc:3055] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:24.786432 30282 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260503 07:58:24.844079 30401 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:24.845093 30282 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:24.844892 30401 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.787843 30417 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260503 07:58:24.846419 30401 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:24.847932 30429 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.849103 30397 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.852262 30374 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:24.843343 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:24.854633 30401 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260503 07:58:24.856171 30377 consensus_meta.cc:287] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.725s user 0.009s sys 0.008s
I20260503 07:58:24.768568 30504 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.856748 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:24.874310 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.875463 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.857122 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:24.859760 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.860769 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.877286 28027 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:24.877945 27999 leader_election.cc:400] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9.
I20260503 07:58:24.878257 27999 leader_election.cc:403] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:24.861743 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.864459 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.864866 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.865733 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:24.878106 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.881820 28027 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:24.882748 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.883874 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:24.862411 30392 raft_consensus.cc:2804] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:24.890267 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.891021 28029 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:24.892014 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.879455 28028 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:24.872663 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:24.896242 27954 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:24.896358 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.822925 30501 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:24.892647 28029 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:24.897354 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:24.884899 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:24.898152 28035 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:24.898382 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.898993 28027 raft_consensus.cc:2368] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:24.899711 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.902221 28033 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:24.906806 28109 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260503 07:58:24.900385 28103 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:24.915572 28029 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:24.916152 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.917238 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.918053 28100 raft_consensus.cc:2393] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 8: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:24.922240 28031 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:24.903714 30477 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:24.856348 30401 consensus_queue.cc:1059] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260503 07:58:24.941061 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 198505us
I20260503 07:58:24.895157 30522 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9.
I20260503 07:58:24.834759 30494 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260503 07:58:24.941602 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 128390us
I20260503 07:58:24.906783 30392 raft_consensus.cc:697] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 9 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:24.942687 30226 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.945168 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:24.900858 30519 consensus_queue.cc:1059] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260503 07:58:24.946131 28103 raft_consensus.cc:1240] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:24.886899 30377 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.950350 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.925170 30558 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:24.949841 28100 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:24.905977 30493 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260503 07:58:24.951254 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:24.953907 28104 raft_consensus.cc:1275] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:24.953790 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:24.955992 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:24.947870 28075 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:24.956107 30226 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.960659 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.962212 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.962806 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.965735 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:24.966300 28105 raft_consensus.cc:3060] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:24.967911 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:24.955215 30474 consensus_meta.cc:287] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.695s user 0.010s sys 0.006s
W20260503 07:58:24.955523 30472 consensus_meta.cc:287] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.710s user 0.011s sys 0.005s
I20260503 07:58:24.970911 28108 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260503 07:58:24.979689 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:24.985397 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:24.987037 30555 log.cc:927] Time spent T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260503 07:58:24.986479 30392 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:24.989042 30377 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:24.966897 30197 consensus_queue.cc:237] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.989404 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:24.989534 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:24.990651 30558 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:24.993685 30425 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:24.995682 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:58:24.996891 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:24.997556 30423 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:24.997889 30474 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:24.998725 30504 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:24.999930 30519 consensus_queue.cc:1059] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:25.000878 30519 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:25.001282 30519 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:25.004372 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:25.004829 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:25.023541 28617 raft_consensus.cc:1240] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:25.022136 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:24.966171 30498 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:25.035950 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 205804us
I20260503 07:58:24.999861 30474 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.022457 30377 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:25.064518 28105 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 9.
W20260503 07:58:25.065687 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 43619.7us
I20260503 07:58:25.002043 30519 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.066478 28075 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.070340 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.076304 28583 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.021567 30472 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.081283 30575 consensus_queue.cc:1059] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:25.082182 30575 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:25.089397 27926 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.067538 30558 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:25.096127 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.098140 27926 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:25.100481 28075 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.101511 30429 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:25.101730 30561 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:25.101963 30429 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:25.102609 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 97750.8us
I20260503 07:58:25.078567 30519 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:25.103742 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.104089 27953 raft_consensus.cc:1240] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:25.102355 30429 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:25.088500 30397 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:25.092048 30522 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:25.060986 30525 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.091091 30559 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:25.091770 30477 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:25.109534 30197 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:25.109619 30357 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.117740 27958 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:25.091827 30423 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:25.118409 30423 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.120183 30423 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:25.109280 30394 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:25.121322 30357 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.107890 28075 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:25.111006 30561 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:25.098781 30446 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:25.114248 30197 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:25.122772 30197 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:25.094411 30563 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260503 07:58:25.132766 30197 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.136866 30197 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.139885 28032 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:25.140336 30502 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:25.141865 30472 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:25.142576 28026 raft_consensus.cc:1240] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:25.142810 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:25.143497 30525 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:25.143932 28614 raft_consensus.cc:2393] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:25.099118 30557 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:25.146725 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.149199 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.158332 28075 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.150789 30561 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:25.160657 30561 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:25.161106 30561 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:25.163138 30556 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:25.163805 30556 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:25.144955 30477 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.165863 30556 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:25.166793 30477 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:25.160177 30277 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260503 07:58:25.170112 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 72010.2us
I20260503 07:58:25.170960 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.171783 27926 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.173986 27926 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:25.174697 30502 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:25.175082 30502 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:25.175426 30502 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:25.186264 30576 log.cc:927] Time spent T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20260503 07:58:25.157295 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:25.188465 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.150668 30557 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.192258 30557 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:25.192168 30429 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.194612 30522 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:25.195050 30522 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:25.185182 30282 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:25.185220 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.203262 27926 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:25.207474 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:25.209215 27926 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.212088 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:25.214480 27926 leader_election.cc:400] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:25.214983 27926 leader_election.cc:403] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260503 07:58:25.216375 27954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45178 (request call id 2216) took 1056 ms. Trace:
I20260503 07:58:25.216881 27954 rpcz_store.cc:276] 0503 07:58:24.159553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:24.160601 (+ 1048us) service_pool.cc:224] Handling call
0503 07:58:25.216182 (+1055581us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54002f0654. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:25.216315 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624670464}
I20260503 07:58:25.219417 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:25.220579 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 57158us
I20260503 07:58:25.144567 30504 consensus_queue.cc:1059] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260503 07:58:25.222592 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:25.185218 30472 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260503 07:58:25.225211 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:25.225898 30226 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:25.226405 30226 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.169785 30524 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260503 07:58:25.210317 30197 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:25.229691 30226 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.144089 30559 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.217449 30563 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:25.216909 30575 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:25.222256 30459 raft_consensus.cc:3055] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:25.221064 30416 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:25.233433 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.232587 30226 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:25.227463 30394 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:25.244994 30226 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:25.246256 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.246644 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.234361 30197 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:25.250890 28075 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:25.234850 30377 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260503 07:58:25.230000 30578 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Leader election lost for term 6. Reason: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7.
I20260503 07:58:25.236075 30563 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:25.253682 30566 log.cc:927] Time spent T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.054s user 0.000s sys 0.001s
I20260503 07:58:25.243047 30416 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:25.282557 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.230073 30423 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260503 07:58:25.242127 30459 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:25.240476 30277 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260503 07:58:25.244628 30415 consensus_queue.cc:1048] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260503 07:58:25.280164 30524 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:25.304823 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.232839 30228 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260503 07:58:25.244302 30421 raft_consensus.cc:3055] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:25.327925 27953 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260503 07:58:25.328454 27955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:25.253849 30429 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.235075 30272 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260503 07:58:25.245620 30523 raft_consensus.cc:3055] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:25.281615 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:25.361320 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 79807.5us
I20260503 07:58:25.233789 30560 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260503 07:58:25.280649 30197 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:25.364986 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:25.343371 27958 raft_consensus.cc:1240] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260503 07:58:25.286940 30563 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:25.348117 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.349545 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.287318 30282 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:25.374887 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.375372 27959 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:25.376610 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:25.377292 28027 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:25.377902 27959 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260503 07:58:25.352789 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.379944 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.312875 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.255652 30394 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.303196 30416 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:25.367605 27956 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:25.371666 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:25.372273 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:25.372562 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:25.350653 30357 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:25.442322 28617 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260503 07:58:25.435879 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.449672 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:25.486812 28034 raft_consensus.cc:2410] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260503 07:58:25.392236 28104 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:25.383315 27957 raft_consensus.cc:1240] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260503 07:58:25.486706 28031 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:25.485491 27958 raft_consensus.cc:1240] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:25.360730 30523 raft_consensus.cc:740] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:25.358067 30543 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:25.350844 30421 raft_consensus.cc:740] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:25.501482 30226 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260503 07:58:25.510988 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:25.511610 28026 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:25.511742 28027 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
W20260503 07:58:25.514533 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:25.509564 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:25.519605 28103 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:25.434619 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:25.527407 28028 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:25.528282 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 277512us
W20260503 07:58:25.532733 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:25.373119 30575 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:25.368543 30574 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:25.548157 28031 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:25.436112 30401 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:25.373411 30282 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:25.359956 30524 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.504088 30543 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:25.569832 30542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s user 0.011s sys 0.014s
I20260503 07:58:25.606820 28026 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
W20260503 07:58:25.591595 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 134261us
I20260503 07:58:25.632946 27926 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:25.638209 30581 log.cc:927] Time spent T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.306s user 0.000s sys 0.001s
I20260503 07:58:25.452811 30459 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.538414 30485 consensus_queue.cc:1059] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260503 07:58:25.506806 30357 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.574079 30401 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.550431 30547 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.405s
I20260503 07:58:25.680630 30417 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:25.723304 30493 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:25.563405 30575 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.716045 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:25.638556 30446 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:25.619535 30543 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:25.715623 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 186819us
W20260503 07:58:25.725322 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:25.754917 28075 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:25.756083 28075 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.726078 30357 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:25.728168 30401 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.574957 30282 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:25.608829 30523 consensus_queue.cc:260] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.729889 28028 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:25.771309 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.772647 28030 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260503 07:58:25.737174 30559 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:25.776167 28104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:25.776795 28104 raft_consensus.cc:606] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.778326 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:25.630772 30542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s user 0.011s sys 0.014s
W20260503 07:58:25.638512 30534 log.cc:927] Time spent T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260503 07:58:25.740401 30226 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:25.757807 28075 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.805399 27956 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 9. Current term is 10. Ops: []
W20260503 07:58:25.741329 30586 log.cc:927] Time spent T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.241s user 0.000s sys 0.001s
W20260503 07:58:25.759289 30585 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.473s user 0.001s sys 0.000s
I20260503 07:58:25.782548 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:25.799887 28073 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:25.805414 30226 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:25.811404 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 53651.9us
I20260503 07:58:25.775467 30423 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:25.783200 30542 raft_consensus.cc:697] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:25.824000 30542 consensus_queue.cc:237] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.820896 30559 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:25.818743 30552 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:25.829905 30582 raft_consensus.cc:993] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:25.830214 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:25.830456 30582 raft_consensus.cc:1081] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:25.778601 30477 consensus_queue.cc:1059] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260503 07:58:25.832233 30477 raft_consensus.cc:3055] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:25.832545 30477 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:25.833266 30477 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.834340 30477 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:25.747645 30417 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.838330 30417 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.839582 30597 consensus_queue.cc:1059] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260503 07:58:25.841086 28619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51178 (request call id 246) took 1016 ms. Trace:
I20260503 07:58:25.841418 28619 rpcz_store.cc:276] 0503 07:58:24.825001 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:24.825152 (+ 151us) service_pool.cc:224] Handling call
0503 07:58:25.840877 (+1015725us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54003dbb54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:25.841001 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485759488}
I20260503 07:58:25.842346 27856 catalog_manager.cc:5671] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 6, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
W20260503 07:58:25.849634 30590 log.cc:927] Time spent T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
W20260503 07:58:25.851080 30589 log.cc:927] Time spent T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.111s user 0.000s sys 0.000s
I20260503 07:58:25.855405 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.856383 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.857255 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.858103 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:25.860296 27952 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260503 07:58:25.844128 27856 catalog_manager.cc:5671] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 3 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
W20260503 07:58:25.864759 30580 log.cc:927] Time spent T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.654s user 0.002s sys 0.000s
I20260503 07:58:25.865474 30524 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.865953 27856 catalog_manager.cc:5671] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:25.868211 30498 raft_consensus.cc:3055] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:25.868602 30498 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:25.869550 30498 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.871006 30498 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:25.871145 30394 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:25.867681 30596 log.cc:927] Time spent T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.064s user 0.000s sys 0.001s
I20260503 07:58:25.878788 30575 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:25.879318 30575 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:25.880066 30519 raft_consensus.cc:3055] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:25.817857 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:25.880879 27958 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:25.817564 27951 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:25.881435 27856 catalog_manager.cc:5671] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:25.813249 28104 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:25.767211 30446 raft_consensus.cc:697] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:25.772282 30558 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:25.823153 28614 raft_consensus.cc:1240] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:25.748190 30493 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.820449 30226 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:25.883208 27856 catalog_manager.cc:5671] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:25.880452 30519 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:25.812366 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.805007 30401 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260503 07:58:25.805469 30523 raft_consensus.cc:3060] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:25.879935 30575 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260503 07:58:25.896780 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 84527.1us
I20260503 07:58:25.911708 28075 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:25.913072 28075 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:25.890324 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 90512.8us
I20260503 07:58:25.896366 30558 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:25.822438 30423 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:25.901096 30446 consensus_queue.cc:237] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:25.894603 27856 catalog_manager.cc:5671] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
W20260503 07:58:25.907419 30502 consensus_meta.cc:287] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.732s user 0.008s sys 0.000s
I20260503 07:58:25.891884 30501 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260503 07:58:25.893483 30522 consensus_meta.cc:287] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.698s user 0.005s sys 0.004s
I20260503 07:58:25.900069 30524 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:25.924868 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:25.923799 27926 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:25.929363 28075 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:25.921227 27856 catalog_manager.cc:5671] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 7, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:25.917153 30547 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:25.961549 28032 raft_consensus.cc:1240] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:25.920760 30423 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:25.982201 30459 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:25.938580 27926 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:25.966665 30421 consensus_queue.cc:260] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:25.938679 30394 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260503 07:58:25.976519 30588 log.cc:927] Time spent T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.198s user 0.002s sys 0.000s
I20260503 07:58:25.962718 30578 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:25.979770 30519 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:25.987897 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 49384us
W20260503 07:58:25.989888 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 60625.5us
I20260503 07:58:25.988929 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:26.001421 30417 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:26.021519 30417 raft_consensus.cc:697] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:26.022608 30417 consensus_queue.cc:237] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.002568 28108 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260503 07:58:26.009438 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 229462us
I20260503 07:58:25.935844 30415 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:25.993372 30282 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:26.013657 28028 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260503 07:58:26.003726 30496 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:26.017261 30561 consensus_meta.cc:287] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.848s user 0.005s sys 0.005s
I20260503 07:58:26.009879 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:25.923600 30502 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.002745 30471 consensus_queue.cc:1059] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260503 07:58:25.944270 30524 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:26.035180 30519 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:25.937530 30522 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.054961 27953 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
W20260503 07:58:26.045354 28617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.004s sys 0.012s
W20260503 07:58:26.045389 28001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s user 0.003s sys 0.012s
I20260503 07:58:26.046311 30604 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
W20260503 07:58:26.055598 28617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s user 0.004s sys 0.012s
W20260503 07:58:26.055962 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 67136.5us
I20260503 07:58:26.073957 27960 raft_consensus.cc:1240] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:26.027137 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.049312 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:26.007058 30501 consensus_queue.cc:1059] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260503 07:58:26.055519 27955 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:26.083290 27955 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:26.028661 30543 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:26.058359 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:26.088658 28034 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9. Ops: []
W20260503 07:58:26.088968 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:26.056248 28001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s user 0.004s sys 0.012s
I20260503 07:58:26.030330 30578 raft_consensus.cc:697] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:26.083745 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 269171us
W20260503 07:58:26.087615 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:26.044291 30561 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.043992 30496 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:26.135722 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 108645us
I20260503 07:58:26.169574 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:26.161474 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:26.157196 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:26.075168 30558 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:26.197985 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.198868 28101 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:26.199630 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:26.137553 28107 raft_consensus.cc:1240] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260503 07:58:26.168109 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.200982 27951 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:26.153733 28616 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 4: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
W20260503 07:58:26.169175 30606 log.cc:927] Time spent T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.078s user 0.001s sys 0.000s
I20260503 07:58:26.213789 28073 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:26.213946 28101 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260503 07:58:26.193814 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:26.215507 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:26.223810 27955 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:26.232623 28109 raft_consensus.cc:1240] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:26.226537 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.235116 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:26.235641 28108 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:26.237583 28583 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.168412 30592 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260503 07:58:26.247082 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 241872us
I20260503 07:58:26.137796 30415 consensus_queue.cc:1059] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260503 07:58:26.215961 30277 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:26.265308 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:26.166791 30560 consensus_queue.cc:1059] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260503 07:58:26.158541 30542 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260503 07:58:26.242151 30559 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:26.252786 27958 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260503 07:58:26.263029 30539 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:26.263166 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.265100 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.274895 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.274895 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.273149 30474 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:26.276141 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.278955 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.286230 30397 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:26.286660 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.287770 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.288074 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:26.288260 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.279407 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.285828 27952 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 10: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:26.238648 30377 consensus_queue.cc:1059] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260503 07:58:26.290248 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.251474 30592 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:26.283476 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.292464 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.194295 30609 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:26.291246 28102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1521) took 1061 ms. Trace:
I20260503 07:58:26.293932 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.293246 28102 rpcz_store.cc:276] 0503 07:58:25.229766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.229886 (+ 120us) service_pool.cc:224] Handling call
0503 07:58:25.241386 (+ 11500us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:25.527997 (+286611us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:25.528016 (+ 19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:25.728460 (+200444us) log.cc:844] Serialized 26 byte log entry
0503 07:58:25.931100 (+202640us) raft_consensus.cc:1645] Marking committed up to 3
0503 07:58:25.931134 (+ 34us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:25.931194 (+ 60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:26.291035 (+359841us) raft_consensus.cc:1685] finished
0503 07:58:26.291053 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:26.291188 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10932,"raft.queue_time_us":94334,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":17902,"thread_start_us":477577,"threads_started":2,"wal-append.queue_time_us":309042}
I20260503 07:58:26.243875 30493 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:26.281025 30559 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:26.275774 30401 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:26.301692 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:26.307019 28028 raft_consensus.cc:2410] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260503 07:58:26.295020 30474 raft_consensus.cc:697] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:26.282778 30282 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:26.292390 30524 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:26.303481 30618 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260503 07:58:26.289618 30502 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:26.313364 28073 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:26.287540 30522 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:26.273512 30357 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260503 07:58:26.301755 27924 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.318812 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:26.295411 30592 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:26.306384 30559 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:26.305879 30543 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:26.334956 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.310812 30614 consensus_queue.cc:1059] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260503 07:58:26.337486 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:26.338851 28026 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260503 07:58:26.339249 27924 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.267830 30574 consensus_queue.cc:1059] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260503 07:58:26.346364 27924 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.238634 30578 consensus_queue.cc:237] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.348531 28026 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260503 07:58:26.333585 30542 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:26.353071 30573 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:26.357604 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.353197 27952 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:26.346958 30565 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:26.333943 30472 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:26.314502 30401 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.355759 30502 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:26.374558 30226 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260503 07:58:26.358415 30602 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.210s user 0.000s sys 0.001s
I20260503 07:58:26.373907 27924 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:26.393680 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 127319us
I20260503 07:58:26.357833 30417 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:26.396773 27954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45176 (request call id 1624) took 1025 ms. Trace:
I20260503 07:58:26.402140 27954 rpcz_store.cc:276] 0503 07:58:25.370826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.372165 (+ 1339us) service_pool.cc:224] Handling call
0503 07:58:25.485881 (+113716us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:25.503313 (+ 17432us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:25.503342 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:25.518885 (+ 15543us) log.cc:844] Serialized 26 byte log entry
0503 07:58:25.917786 (+398901us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:25.917836 (+ 50us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:25.917914 (+ 78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:26.396501 (+478587us) raft_consensus.cc:1685] finished
0503 07:58:26.396528 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:26.396678 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7091,"raft.queue_time_us":7219,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":316811,"threads_started":1,"wal-append.queue_time_us":468433}
I20260503 07:58:26.364207 30496 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:26.363463 30561 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:26.379752 30522 raft_consensus.cc:476] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260503 07:58:26.408114 27924 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.379698 30597 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:26.425184 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.422820 28614 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:26.394558 30573 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:26.431056 30573 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:26.381515 30557 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260503 07:58:26.417162 30282 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:26.443603 30401 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:26.428287 30607 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:26.400784 30565 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.454648 30417 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:26.455154 30522 raft_consensus.cc:3055] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:26.428614 30496 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
W20260503 07:58:26.456832 30523 consensus_meta.cc:287] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.538s user 0.005s sys 0.002s
I20260503 07:58:26.382414 30474 consensus_queue.cc:237] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.425333 30597 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.559104 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:26.686926 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:58:26.698611 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 273036us
W20260503 07:58:26.595134 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:26.700143 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:26.560151 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.451897 30557 consensus_queue.cc:1243] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260503 07:58:26.579241 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.562029 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:26.564038 28028 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260503 07:58:26.466009 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:26.579494 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:26.735821 27924 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:26.561589 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:26.762704 28028 pending_rounds.cc:85] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 5
I20260503 07:58:26.764326 28028 pending_rounds.cc:107] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260503 07:58:26.764961 28028 raft_consensus.cc:2889] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260503 07:58:26.764680 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 185504us
I20260503 07:58:26.766136 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.767203 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.768560 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:26.771874 28035 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
W20260503 07:58:26.582283 30563 consensus_meta.cc:287] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 1.147s user 0.010s sys 0.000s
W20260503 07:58:26.702273 30627 log.cc:927] Time spent T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.227s user 0.000s sys 0.000s
W20260503 07:58:26.601135 30423 consensus_meta.cc:287] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.620s user 0.005s sys 0.005s
I20260503 07:58:26.787505 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:26.553861 30608 log.cc:927] Time spent T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.456s user 0.000s sys 0.001s
W20260503 07:58:26.692162 30630 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.250s user 0.000s sys 0.000s
I20260503 07:58:26.462348 30522 raft_consensus.cc:740] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:26.691789 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:58:26.790525 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:26.828079 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.812956 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:26.863358 28029 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:26.864053 30636 log.cc:927] Time spent T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260503 07:58:26.864113 30401 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:26.611718 30416 consensus_meta.cc:287] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 1.102s user 0.011s sys 0.000s
I20260503 07:58:26.562901 30561 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:26.702533 30573 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:26.856416 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 258078us
I20260503 07:58:26.866082 28075 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:26.602349 30633 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:26.703354 30197 consensus_meta.cc:287] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 1.319s user 0.011s sys 0.000s
I20260503 07:58:26.581965 30558 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:26.542141 30477 raft_consensus.cc:3055] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:26.470269 30496 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:26.773497 30523 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
W20260503 07:58:26.847334 30519 consensus_meta.cc:287] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.790s user 0.009s sys 0.000s
I20260503 07:58:26.910562 30421 raft_consensus.cc:3060] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:26.913220 30478 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:26.774718 30599 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:26.773682 30459 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:26.904702 30416 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.602288 30559 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.915283 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1318) took 1539 ms. Trace:
I20260503 07:58:26.995755 28033 rpcz_store.cc:276] 0503 07:58:25.375613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.375750 (+ 137us) service_pool.cc:224] Handling call
0503 07:58:25.376084 (+ 334us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:25.661941 (+285857us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:25.661983 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:25.715797 (+ 53814us) log.cc:844] Serialized 26 byte log entry
0503 07:58:25.919743 (+203946us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:25.919785 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:25.919859 (+ 74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:26.543190 (+623331us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f85042bec0e 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1 00007f85042c7579 00007f85042c7509
0503 07:58:26.915016 (+371826us) raft_consensus.cc:1685] finished
0503 07:58:26.915038 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:26.915230 (+ 192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3733,"raft.queue_time_us":64074,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13542,"spinlock_wait_cycles":15450368,"thread_start_us":392845,"threads_started":2,"wal-append.queue_time_us":293478}
I20260503 07:58:26.914937 30522 consensus_queue.cc:260] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.915572 28029 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:26.915827 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:26.901655 30525 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:26.832618 30625 log.cc:927] Time spent T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.101s user 0.000s sys 0.000s
I20260503 07:58:26.864790 30401 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.018707 30401 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:26.921746 27958 raft_consensus.cc:1240] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
W20260503 07:58:26.923218 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 57242.9us
W20260503 07:58:26.924422 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 188679us
I20260503 07:58:27.020298 28075 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:27.020354 27924 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:26.922072 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:26.836881 30632 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:26.814461 30524 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:26.931347 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:26.773743 30471 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:26.934563 28101 raft_consensus.cc:1240] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:26.987562 28027 raft_consensus.cc:2410] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260503 07:58:26.788146 30609 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:26.990775 30478 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:27.032065 30471 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.032584 30478 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:26.560708 30629 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.486s
I20260503 07:58:26.901546 30557 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:26.901602 30485 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:26.922808 30542 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:26.806561 30563 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.008167 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:27.065423 28033 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:27.013079 28616 raft_consensus.cc:1240] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:26.925428 30575 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:26.924239 30477 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:27.026871 28032 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:27.031026 27951 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:26.922096 30277 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.050055 28106 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260503 07:58:27.050316 27954 raft_consensus.cc:1240] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:26.903021 30423 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.917232 30561 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.097467 27956 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:26.917371 30197 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:26.990475 30519 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:26.991509 30618 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.033151 30591 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:26.995007 30565 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.057664 28075 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:26.905239 30573 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.062741 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:27.074648 28033 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:27.036724 30522 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:27.027943 30459 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.050834 30560 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:27.055606 30374 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.023707 30525 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.137818 30559 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:27.138625 30525 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.139936 30573 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:27.142843 30592 consensus_meta.cc:287] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.795s user 0.003s sys 0.006s
I20260503 07:58:27.143343 30592 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.146667 30197 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.109839 30417 raft_consensus.cc:2764] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260503 07:58:27.051258 30557 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:26.932915 30633 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.075428 30642 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.110606 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:27.192886 28103 raft_consensus.cc:2393] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:27.113461 28100 raft_consensus.cc:2393] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 9: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:27.200155 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:27.123860 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 66298.8us
I20260503 07:58:27.201737 28075 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:27.097561 30394 raft_consensus.cc:3055] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:27.077682 30644 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:27.053839 30524 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.063598 30485 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.076279 30542 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.223359 28035 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:27.133088 28617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51194 (request call id 333) took 1617 ms. Trace:
I20260503 07:58:27.099920 30277 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:27.132778 30374 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.059154 30401 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.173105 27958 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:27.175709 28027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:27.182080 27955 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.110474 30618 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.172770 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:27.116880 27951 raft_consensus.cc:1240] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260503 07:58:27.204854 28032 raft_consensus.cc:2468] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:27.091387 30575 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.120251 30597 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.149740 30558 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:27.224493 28075 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:27.133420 27957 raft_consensus.cc:1240] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:27.224126 28617 rpcz_store.cc:276] 0503 07:58:25.513270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.513573 (+ 303us) service_pool.cc:224] Handling call
0503 07:58:25.513876 (+ 303us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:26.074169 (+560293us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:26.074258 (+ 89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:26.074873 (+ 615us) log.cc:844] Serialized 26 byte log entry
0503 07:58:26.299181 (+224308us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:26.299215 (+ 34us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:26.299763 (+ 548us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:27.130961 (+831198us) raft_consensus.cc:1685] finished
0503 07:58:27.130984 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:27.131094 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16483,"raft.queue_time_us":38913,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":21824,"thread_start_us":776386,"threads_started":2,"wal-append.queue_time_us":235667}
I20260503 07:58:27.183416 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:27.107450 30519 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:27.208756 30623 log.cc:927] Time spent T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.759s user 0.004s sys 0.000s
I20260503 07:58:27.226655 30614 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:27.185684 30446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.042s sys 0.033s
I20260503 07:58:27.251358 28027 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:27.229760 30560 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:27.267951 28027 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:27.061411 30632 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.207382 30394 raft_consensus.cc:740] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:27.214414 30644 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:27.259976 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:27.258360 28103 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:27.150417 30459 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:27.262499 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 340482us
W20260503 07:58:27.264470 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 244210us
I20260503 07:58:27.265720 28075 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:27.198472 30547 consensus_queue.cc:1059] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260503 07:58:27.251740 27955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45176 (request call id 1612) took 1923 ms. Trace:
I20260503 07:58:27.191365 30477 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.237668 30599 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.296809 28032 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260503 07:58:27.297219 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:27.279441 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:27.288235 27958 raft_consensus.cc:1240] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:27.255537 30416 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.255491 30417 raft_consensus.cc:476] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260503 07:58:27.292826 27955 rpcz_store.cc:276] 0503 07:58:25.306888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.310383 (+ 3495us) service_pool.cc:224] Handling call
0503 07:58:27.180788 (+1870405us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400118854. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850471be1d 00007f85096fa390 00007f8502c713b4 00007f8502c71342 00007f8502c71271 00007f8502c711ec 00007f8502c704a2 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:27.230173 (+ 49385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619761536}
W20260503 07:58:27.267751 30446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s user 0.042s sys 0.033s
I20260503 07:58:27.296299 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:27.297640 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2038) took 1005 ms. Trace:
I20260503 07:58:27.267729 30591 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:27.269115 30559 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:27.315153 30599 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.292564 30547 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260503 07:58:27.252862 30401 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:27.293654 30640 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.294s user 0.000s sys 0.001s
I20260503 07:58:27.386297 28614 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:27.287514 30471 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:27.293237 30644 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:27.420292 27959 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:27.273252 30496 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.213410 30642 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.312084 30558 consensus_queue.cc:1059] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260503 07:58:27.428043 30394 consensus_queue.cc:260] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:27.398087 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:27.270210 30614 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:27.842679 28033 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s user 0.049s sys 0.051s
I20260503 07:58:27.891160 30604 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.505906 30478 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.896313 30551 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.682543 30522 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:27.896796 30615 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.896900 30551 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:27.883082 30649 log.cc:927] Time spent T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.462s user 0.000s sys 0.000s
I20260503 07:58:27.897320 30522 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.897464 30615 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.898902 30551 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.899245 30522 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:27.899444 30599 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.899453 30615 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:27.888639 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:27.800792 30557 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:27.489763 28030 raft_consensus.cc:1275] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260503 07:58:27.504068 30523 consensus_meta.cc:287] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.516s user 0.006s sys 0.000s
I20260503 07:58:27.900818 30648 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.900584 28100 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 7: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:58:27.507218 30619 log.cc:927] Time spent T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 1.142s user 0.002s sys 0.000s
I20260503 07:58:27.901576 30648 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.902146 30478 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:27.902328 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:27.529222 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:27.902971 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 606704us
I20260503 07:58:27.903234 30642 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.903497 30525 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260503 07:58:27.640430 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 348451us
I20260503 07:58:27.493197 30485 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.510654 28109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1526) took 2213 ms. Trace:
I20260503 07:58:27.904624 28109 rpcz_store.cc:276] 0503 07:58:25.297575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.390043 (+ 92468us) service_pool.cc:224] Handling call
0503 07:58:25.390348 (+ 305us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:26.233093 (+842745us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:27.510371 (+1277278us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400019fd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:27.510561 (+ 190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920590592}
W20260503 07:58:27.905321 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:27.905189 30559 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:27.506699 30647 log.cc:927] Time spent T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260503 07:58:27.895244 28032 rpcz_store.cc:276] 0503 07:58:26.292217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.296355 (+1004138us) service_pool.cc:224] Handling call
0503 07:58:27.296599 (+ 244us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:27.297430 (+ 831us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:27.297592 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:27.509577 30542 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:27.499056 30633 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:27.507687 30519 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.498665 30524 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.907262 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:27.886550 30477 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:27.907239 30559 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:27.909353 30614 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.718077 30632 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.900990 30523 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:27.504513 28027 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.911353 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:27.911959 28616 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:27.912485 28027 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:27.912949 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:33294 (request call id 2037) took 1629 ms. Trace:
I20260503 07:58:27.913270 28027 rpcz_store.cc:276] 0503 07:58:26.283519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.175605 (+892086us) service_pool.cc:224] Handling call
0503 07:58:27.912871 (+737266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:27.913602 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:27.914340 28616 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:27.914824 28026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2033) took 1632 ms. Trace:
I20260503 07:58:27.915225 28026 rpcz_store.cc:276] 0503 07:58:26.282546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.355978 (+ 73432us) service_pool.cc:224] Handling call
0503 07:58:26.356272 (+ 294us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:26.363794 (+ 7522us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:26.363834 (+ 40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:26.385102 (+ 21268us) log.cc:844] Serialized 26 byte log entry
0503 07:58:26.445832 (+ 60730us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:26.454154 (+ 8322us) log.cc:844] Serialized 14 byte log entry
0503 07:58:26.454309 (+ 155us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:26.454369 (+ 60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:27.914637 (+1460268us) raft_consensus.cc:1685] finished
0503 07:58:27.914658 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:27.914767 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7095,"prepare.queue_time_us":8490,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":15412,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12540,"thread_start_us":17952,"threads_started":1,"wal-append.queue_time_us":426063}
I20260503 07:58:27.918704 28032 raft_consensus.cc:2393] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:27.919281 30523 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.919376 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:58:27.919817 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:27.920271 30599 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.483207 30374 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:27.921768 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:27.919970 30523 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:27.842334 30578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.233s user 0.006s sys 0.008s
I20260503 07:58:27.922610 30599 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:27.941648 30599 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.923647 30394 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:27.944555 30594 raft_consensus.cc:3055] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:27.945087 30594 raft_consensus.cc:740] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:27.926246 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:27.924499 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:27.947217 28027 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:27.948562 28027 raft_consensus.cc:1240] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:27.498016 30459 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:27.895938 28033 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s user 0.052s sys 0.054s
I20260503 07:58:27.927484 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:27.887874 27958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2272) took 1021 ms. Trace:
I20260503 07:58:27.930536 28102 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:27.608466 27953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2266) took 1282 ms. Trace:
I20260503 07:58:27.921785 30522 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.952317 27958 rpcz_store.cc:276] 0503 07:58:26.866071 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.259201 (+393130us) service_pool.cc:224] Handling call
0503 07:58:27.288056 (+ 28855us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.298019 (+ 9963us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:27.887825 (+589806us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:27.483187 30646 log.cc:927] Time spent T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.253s user 0.000s sys 0.001s
I20260503 07:58:27.949342 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2041) took 1656 ms. Trace:
I20260503 07:58:27.639936 30563 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:27.929411 30630 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.494s user 0.001s sys 0.009s
I20260503 07:58:27.474643 30609 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.951273 28585 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:27.493848 30277 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:27.896236 30604 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:27.951766 28029 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s user 0.015s sys 0.013s
W20260503 07:58:27.939926 30578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s user 0.007s sys 0.008s
I20260503 07:58:27.475117 30423 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:27.926039 30575 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:27.953382 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 49079.6us
I20260503 07:58:27.444808 30561 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:27.926594 30519 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:27.926414 30633 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:27.925124 30377 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:27.946084 30594 consensus_queue.cc:260] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:27.952381 28109 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:28.150471 28027 rpcz_store.cc:276] 0503 07:58:26.293118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.947983 (+1654865us) service_pool.cc:224] Handling call
0503 07:58:27.948314 (+ 331us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:27.949060 (+ 746us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:27.949278 (+ 218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:28.154338 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:28.154433 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.154536 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.151257 28075 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:28.154918 28027 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:27.939373 30632 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:28.155269 28109 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:27.953735 27953 rpcz_store.cc:276] 0503 07:58:26.326187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.909407 (+583220us) service_pool.cc:224] Handling call
0503 07:58:26.909725 (+ 318us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:26.918295 (+ 8570us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:26.918324 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:26.925808 (+ 7484us) log.cc:844] Serialized 26 byte log entry
0503 07:58:27.262186 (+336378us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:27.262250 (+ 64us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:27.262330 (+ 80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:27.608198 (+345868us) raft_consensus.cc:1685] finished
0503 07:58:27.608227 (+ 29us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:27.608397 (+ 170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28152,"raft.queue_time_us":82413,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":29259,"thread_start_us":267352,"threads_started":1,"wal-append.queue_time_us":419646}
W20260503 07:58:27.985404 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:28.142071 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:28.155082 28100 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:27.953893 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:27.937433 30618 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:27.948594 30524 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:28.154800 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:28.177253 28029 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s user 0.021s sys 0.017s
I20260503 07:58:28.055512 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:28.179193 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 222081us
I20260503 07:58:28.179849 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:27.949190 30614 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:28.174878 28101 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:28.201553 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.044950 30551 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:27.952247 30471 raft_consensus.cc:3055] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:28.207401 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:28.182689 28075 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:28.044792 30558 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:28.223340 27952 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:28.168138 30609 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.224517 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.231504 28100 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:27.953135 30374 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:28.205143 28109 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:28.102463 30557 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:28.221782 28027 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:28.233461 30594 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:28.237293 30557 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.237802 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:28.238842 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:27.955103 30485 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:28.227772 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 45160.2us
I20260503 07:58:28.239290 30557 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.239558 30485 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.234985 30558 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.241473 30485 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.241776 30558 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.241946 28027 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:28.206301 30648 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.203334 30661 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:28.240058 28075 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
W20260503 07:58:28.253657 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 70495.2us
I20260503 07:58:28.227797 30421 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:27.953049 30599 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
W20260503 07:58:28.235718 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 132958us
I20260503 07:58:28.102286 30591 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:28.018164 30477 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.209s
W20260503 07:58:28.250844 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 299625us
I20260503 07:58:28.167954 30377 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.254544 28027 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:28.226840 30471 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:28.167819 30633 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.255261 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:28.272861 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.227743 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.256069 28101 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:28.168264 30522 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.229781 30423 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:28.175119 30519 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.232900 30551 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.222752 30614 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.227514 30561 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260503 07:58:28.260036 30663 log.cc:927] Time spent T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.120s user 0.001s sys 0.000s
I20260503 07:58:28.260375 30523 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:28.287245 30658 log.cc:927] Time spent T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260503 07:58:28.181579 30632 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.288057 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2034) took 2005 ms. Trace:
I20260503 07:58:28.288825 30632 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.203900 30524 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.289084 28104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 327) took 1675 ms. Trace:
I20260503 07:58:28.257171 30421 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:58:28.266083 30657 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20260503 07:58:28.242709 30401 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.236122 30496 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:28.296025 30496 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:28.296391 30496 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:28.298264 30551 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.299326 30609 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.252497 30656 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:28.299825 30656 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:28.300137 30656 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:28.267949 30542 consensus_queue.cc:1059] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260503 07:58:28.275725 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:28.278627 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:28.300915 28109 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:28.268060 30547 consensus_queue.cc:1059] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260503 07:58:28.274468 30599 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.266636 30591 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.280507 30519 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.280980 30522 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.281545 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:28.243480 30374 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.304605 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:28.259475 30557 raft_consensus.cc:2804] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:28.288415 28029 rpcz_store.cc:276] 0503 07:58:26.282786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.021292 (+738506us) service_pool.cc:224] Handling call
0503 07:58:27.021652 (+ 360us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:27.022031 (+ 379us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:27.022070 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:27.031478 (+ 9408us) log.cc:844] Serialized 26 byte log entry
0503 07:58:27.295290 (+263812us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:28.177727 (+882437us) log.cc:844] Serialized 14 byte log entry
0503 07:58:28.207146 (+ 29419us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.207209 (+ 63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:28.287875 (+ 80666us) raft_consensus.cc:1685] finished
0503 07:58:28.287895 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.288006 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29165,"prepare.queue_time_us":938116,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":54821,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"spinlock_wait_cycles":9240320,"thread_start_us":965659,"threads_started":2,"wal-append.queue_time_us":1143529}
I20260503 07:58:28.267453 30558 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:28.289404 28104 rpcz_store.cc:276] 0503 07:58:26.614209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.733794 (+119585us) service_pool.cc:224] Handling call
0503 07:58:26.734219 (+ 425us) raft_consensus.cc:1471] Updating replica for 2 ops
0503 07:58:26.754636 (+ 20417us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:26.754676 (+ 40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0503 07:58:26.755501 (+ 825us) log.cc:844] Serialized 52 byte log entry
0503 07:58:27.179099 (+423598us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b180004c600. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501669587 00007f850a462bc9 00007f8501685cdb 00007f8501683f7f 00007f8501686242 00007f85042bd5ab 00007f85042c30c3 00007f85042c3471 00007f85046dfdef
0503 07:58:27.415929 (+236830us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:27.415990 (+ 61us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:27.416090 (+ 100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:28.288820 (+872730us) raft_consensus.cc:1685] finished
0503 07:58:28.288837 (+ 17us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.289030 (+ 193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72325,"raft.queue_time_us":30756,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":53294,"spinlock_wait_cycles":48809344,"thread_start_us":235982,"threads_started":1,"wal-append.queue_time_us":1433943}
I20260503 07:58:28.317332 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.317858 28104 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 3.
I20260503 07:58:28.318511 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.319000 28104 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:28.269150 30277 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:28.274495 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:28.294916 30421 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:28.300647 30542 consensus_queue.cc:1243] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260503 07:58:28.302363 30471 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.303181 28102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57291cbb014449748e69000cc57c9e10"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:28.325320 28102 raft_consensus.cc:606] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:28.321823 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:28.285338 30644 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.316545 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2026) took 2035 ms. Trace:
W20260503 07:58:28.323410 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:28.324368 28109 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:28.304944 30547 raft_consensus.cc:3055] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:28.328310 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:28.307251 30618 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:28.304494 30661 raft_consensus.cc:697] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:28.329053 27960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2246) took 2543 ms. Trace:
W20260503 07:58:28.422302 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:28.482219 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:28.355072 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:28.328336 28031 rpcz_store.cc:276] 0503 07:58:26.280833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.289552 (+ 8719us) service_pool.cc:224] Handling call
0503 07:58:26.304417 (+ 14865us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:26.314917 (+ 10500us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:26.314954 (+ 37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:26.320077 (+ 5123us) log.cc:844] Serialized 26 byte log entry
0503 07:58:26.418004 (+ 97927us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:26.440963 (+ 22959us) log.cc:844] Serialized 14 byte log entry
0503 07:58:26.564830 (+123867us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:26.564935 (+ 105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:28.302464 (+1737529us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b180015e680. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:58:28.314210 (+ 11746us) raft_consensus.cc:1685] finished
0503 07:58:28.316364 (+ 2154us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.316500 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75815,"prepare.queue_time_us":22772,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":24487,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4490,"spinlock_wait_cycles":13474560,"thread_start_us":70670,"threads_started":1,"wal-append.queue_time_us":131613}
I20260503 07:58:28.316037 30377 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.481149 27960 rpcz_store.cc:276] 0503 07:58:25.778531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.779242 (+ 711us) service_pool.cc:224] Handling call
0503 07:58:25.779510 (+ 268us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:26.074295 (+294785us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.321714 (+2247419us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400050fd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.321877 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676788608}
I20260503 07:58:28.333851 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1325) took 2571 ms. Trace:
W20260503 07:58:28.483954 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 162195us
I20260503 07:58:28.489226 28034 rpcz_store.cc:276] 0503 07:58:25.754896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.755023 (+ 127us) service_pool.cc:224] Handling call
0503 07:58:25.755249 (+ 226us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:26.089144 (+333895us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.326176 (+2237032us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540024ccd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.326278 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766311680}
I20260503 07:58:28.489656 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:28.490785 28034 raft_consensus.cc:1240] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:28.492412 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:28.493531 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:28.494168 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:28.494786 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1329) took 2180 ms. Trace:
I20260503 07:58:28.495114 28034 rpcz_store.cc:276] 0503 07:58:26.314739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.490463 (+2175724us) service_pool.cc:224] Handling call
0503 07:58:28.490676 (+ 213us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:28.494617 (+ 3941us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.494747 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:28.316569 30519 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:28.497637 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.498461 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1331) took 2180 ms. Trace:
I20260503 07:58:28.498699 30401 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:28.498884 28034 rpcz_store.cc:276] 0503 07:58:26.315261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.495627 (+2180366us) service_pool.cc:224] Handling call
0503 07:58:28.495815 (+ 188us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:28.495933 (+ 118us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:28.495947 (+ 14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:28.495971 (+ 24us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:28.495993 (+ 22us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.496023 (+ 30us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.496083 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:28.500757 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1332) took 2153 ms. Trace:
I20260503 07:58:28.359058 30574 raft_consensus.cc:3055] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:28.501155 28034 rpcz_store.cc:276] 0503 07:58:26.348264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.500038 (+2151774us) service_pool.cc:224] Handling call
0503 07:58:28.500282 (+ 244us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:28.500442 (+ 160us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:28.500466 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:28.500506 (+ 40us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:28.500558 (+ 52us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.500604 (+ 46us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.500703 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:28.489173 30673 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260503 07:58:28.503139 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:28.505165 30522 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:28.355849 30614 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.497165 30575 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:28.499131 30401 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:28.500002 30519 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:28.500116 30618 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:28.356345 30604 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:28.506672 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:28.481546 30471 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:28.514943 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:28.496965 30552 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:28.355954 30374 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:28.396548 30633 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.333177 30557 raft_consensus.cc:697] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:28.515419 30522 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:28.515542 30673 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:28.522122 30591 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:28.500382 30667 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:28.523116 30644 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:28.481132 30547 raft_consensus.cc:740] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:28.510315 30574 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:28.526588 28030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 443) took 2515 ms. Trace:
I20260503 07:58:28.325349 30558 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.527053 30415 raft_consensus.cc:3055] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:28.357641 30599 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.452785 30496 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.328832 30277 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.453378 30421 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.451196 30656 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:28.526837 30661 consensus_queue.cc:237] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.192418 30652 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:28.940591 30556 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:29.223498 30652 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.224045 30556 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.225744 30652 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:29.193220 27957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2242) took 3415 ms. Trace:
I20260503 07:58:29.226512 30556 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:29.187521 27952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2262) took 2880 ms. Trace:
I20260503 07:58:29.227577 27952 rpcz_store.cc:276] 0503 07:58:26.307221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.366568 (+ 59347us) service_pool.cc:224] Handling call
0503 07:58:26.366872 (+ 304us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:28.229415 (+1862543us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.187253 (+957838us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540018d654. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:29.187452 (+ 199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4268969728}
I20260503 07:58:28.940344 30672 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:29.229290 30672 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.229614 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.226508 27957 rpcz_store.cc:276] 0503 07:58:25.777392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.778745 (+ 1353us) service_pool.cc:224] Handling call
0503 07:58:25.778975 (+ 230us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.261216 (+1482241us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.192946 (+1931730us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002e9354. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:29.193156 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3111328000}
I20260503 07:58:29.231333 30672 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:28.669420 30614 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.231680 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.232220 30614 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.233093 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.233966 30614 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.056339 27956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2248) took 3245 ms. Trace:
I20260503 07:58:29.234949 27856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33434 (request call id 323) took 4904 ms. Trace:
I20260503 07:58:29.235118 30522 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
W20260503 07:58:29.135135 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.062157 30592 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:29.235364 27856 rpcz_store.cc:276] 0503 07:58:24.330411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:24.330610 (+ 199us) service_pool.cc:224] Handling call
0503 07:58:29.234845 (+4904235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:26.327526 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:26.380079 (+ 52553us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:26.382855 (+ 2776us) write_op.cc:435] Acquired schema lock
0503 07:58:26.394643 (+ 11788us) tablet.cc:662] Decoding operations
0503 07:58:26.613241 (+218598us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:26.613296 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:26.613321 (+ 25us) tablet.cc:685] Acquiring locks for 7 operations
0503 07:58:26.904853 (+291532us) tablet.cc:701] Row locks acquired
0503 07:58:26.916384 (+ 11531us) write_op.cc:260] PREPARE: finished
0503 07:58:26.916506 (+ 122us) write_op.cc:270] Start()
0503 07:58:26.916611 (+ 105us) write_op.cc:276] Timestamp: P: 1777795106916470 usec, L: 0
0503 07:58:26.916634 (+ 23us) op_driver.cc:348] REPLICATION: starting
0503 07:58:27.028228 (+111594us) log.cc:844] Serialized 2828 byte log entry
0503 07:58:28.499038 (+1470810us) op_driver.cc:464] REPLICATION: finished
0503 07:58:29.222807 (+723769us) write_op.cc:301] APPLY: starting
0503 07:58:29.222885 (+ 78us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:29.223053 (+ 168us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:29.223166 (+ 113us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:29.223939 (+ 773us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:29.224181 (+ 242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0503 07:58:29.224245 (+ 64us) write_op.cc:312] APPLY: finished
0503 07:58:29.224467 (+ 222us) log.cc:844] Serialized 59 byte log entry
0503 07:58:29.225206 (+ 739us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:29.225305 (+ 99us) write_op.cc:454] Released schema lock
0503 07:58:29.225351 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":723509,"num_ops":7,"prepare.queue_time_us":331991,"prepare.run_cpu_time_us":42018,"prepare.run_wall_time_us":973911,"raft.queue_time_us":170739,"raft.run_cpu_time_us":124644,"raft.run_wall_time_us":211690,"replication_time_us":1582230,"thread_start_us":685434,"threads_started":4,"wal-append.queue_time_us":1006156}]]}
I20260503 07:58:29.238269 30277 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:28.757388 28103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43222 (request call id 1667) took 1607 ms (client timeout 1911 ms). Trace:
W20260503 07:58:29.239214 28103 rpcz_store.cc:269] 0503 07:58:27.150278 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.199893 (+ 49615us) service_pool.cc:224] Handling call
0503 07:58:28.757156 (+1557263us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b5400048dd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:28.757316 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132330240}
I20260503 07:58:29.239856 27926 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:29.240267 30415 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:29.240206 30574 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.158927 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:28.729077 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.241456 30574 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:29.241294 30415 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.242065 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:28.817032 30611 raft_consensus.cc:3055] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:29.243083 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:29.243554 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:29.243800 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 728864us
I20260503 07:58:29.158604 27954 raft_consensus.cc:1240] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:28.811995 28108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 325) took 2413 ms. Trace:
I20260503 07:58:29.245514 30472 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:28.817310 30543 raft_consensus.cc:3055] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:29.246148 30543 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:29.246037 30472 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.247205 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33288 (request call id 1347) took 1290 ms. Trace:
I20260503 07:58:29.247033 30543 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.247581 28027 rpcz_store.cc:276] 0503 07:58:27.956520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.238630 (+282110us) service_pool.cc:224] Handling call
0503 07:58:29.186702 (+948072us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b540026be54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:29.247146 (+ 60444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5982592}
I20260503 07:58:29.248100 30543 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:28.816192 27959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2260) took 2643 ms. Trace:
I20260503 07:58:29.249305 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1337) took 2786 ms. Trace:
I20260503 07:58:29.244674 30525 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.249358 27959 rpcz_store.cc:276] 0503 07:58:26.172348 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.172462 (+ 114us) service_pool.cc:224] Handling call
0503 07:58:26.172775 (+ 313us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.921243 (+1748468us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.815995 (+894752us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540007f8d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.816139 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868644608}
I20260503 07:58:29.250427 30525 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:28.669713 30401 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:29.252262 30525 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.252547 30472 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.252712 30525 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:28.669952 30618 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:29.254315 30618 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:28.671330 28107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43222 (request call id 1638) took 3771 ms. Trace:
I20260503 07:58:29.255190 27960 raft_consensus.cc:1240] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260503 07:58:29.255357 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.255970 27954 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:29.256021 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:28.967314 30631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.951s user 0.002s sys 0.022s
I20260503 07:58:28.669355 30459 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.234988 27956 rpcz_store.cc:276] 0503 07:58:25.810797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:25.810942 (+ 145us) service_pool.cc:224] Handling call
0503 07:58:25.811182 (+ 240us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.098014 (+1286832us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.056092 (+1958078us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002f0b54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:29.056271 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2957736320}
I20260503 07:58:29.257637 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.257306 30459 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.258345 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.258919 27956 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:29.157709 30563 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.259310 30459 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.259673 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.260453 27956 raft_consensus.cc:2393] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:28.843053 28619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51178 (request call id 250) took 2425 ms. Trace:
I20260503 07:58:29.261499 30421 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:29.261998 28029 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:28.670171 30519 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:29.113330 30654 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:28.755991 30675 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:29.263214 30654 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.264068 28029 raft_consensus.cc:1240] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:29.263783 30675 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.114220 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.265453 30654 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.265652 27955 raft_consensus.cc:2410] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260503 07:58:29.113894 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.259637 30563 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.245699 28108 rpcz_store.cc:276] 0503 07:58:26.399036 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.399146 (+ 110us) service_pool.cc:224] Handling call
0503 07:58:26.912807 (+513661us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b58001c5698. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:58:26.912966 (+ 159us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.131414 (+218448us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:27.131457 (+ 43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:27.131524 (+ 67us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:27.131569 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.811699 (+1680130us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540004a1d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.811771 (+ 72us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.811934 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504868992}
I20260503 07:58:29.234470 28030 rpcz_store.cc:276] 0503 07:58:26.010766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.010956 (+ 190us) service_pool.cc:224] Handling call
0503 07:58:26.029063 (+ 18107us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.900689 (+1871626us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.523940 (+623251us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540015a254. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.526527 (+ 2587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3358389120}
I20260503 07:58:29.271966 30563 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:29.238335 30667 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.111976 30478 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:29.264680 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1338) took 2706 ms. Trace:
I20260503 07:58:29.242458 30415 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:28.858875 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2029) took 2577 ms. Trace:
I20260503 07:58:29.267661 30673 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:29.266893 30591 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:28.628556 30609 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:29.055821 28032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43620 (request call id 452) took 1622 ms (client timeout 1597 ms). Trace:
W20260503 07:58:29.282054 28032 rpcz_store.cc:269] 0503 07:58:27.433359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.907074 (+473715us) service_pool.cc:224] Handling call
0503 07:58:29.055598 (+1148524us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b540029b8d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:29.055747 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23301376}
I20260503 07:58:29.283833 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1340) took 2724 ms. Trace:
I20260503 07:58:29.284211 28032 rpcz_store.cc:276] 0503 07:58:26.559227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.283131 (+2723904us) service_pool.cc:224] Handling call
0503 07:58:29.283369 (+ 238us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.283521 (+ 152us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.283544 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.283581 (+ 37us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:29.283622 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.283670 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.283773 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:29.087196 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:28.819466 28585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 2.455s (SENT) [suppressed 24 similar messages]
W20260503 07:58:29.082775 28614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51178 (request call id 253) took 2396 ms (client timeout 2258 ms). Trace:
W20260503 07:58:29.287598 28614 rpcz_store.cc:269] 0503 07:58:26.686248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.686601 (+ 353us) service_pool.cc:224] Handling call
0503 07:58:29.082540 (+2395939us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400771354. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:29.082665 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579830144}
I20260503 07:58:29.083385 27924 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:29.269577 28105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 324) took 2870 ms. Trace:
I20260503 07:58:29.288779 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.258560 30547 consensus_queue.cc:260] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:29.256739 30631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.240s user 0.004s sys 0.032s
I20260503 07:58:29.288743 28105 rpcz_store.cc:276] 0503 07:58:26.398716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.398825 (+ 109us) service_pool.cc:224] Handling call
0503 07:58:29.034835 (+2636010us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b58001c5698. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f850970c680 00007f85096f6fe9 00007f85096f6a92 00007f8502c60d34
0503 07:58:29.267408 (+232573us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.267559 (+ 151us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.269303 (+ 1744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.269345 (+ 42us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:29.269387 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.269438 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.269529 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3168640}
I20260503 07:58:29.256786 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:29.112864 30474 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:29.266448 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.298324 27955 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:29.273058 28029 rpcz_store.cc:276] 0503 07:58:26.558654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.263634 (+2704980us) service_pool.cc:224] Handling call
0503 07:58:29.263918 (+ 284us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.264435 (+ 517us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.264624 (+ 189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:29.299571 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 447) took 2600 ms. Trace:
I20260503 07:58:29.300130 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:29.300033 28032 rpcz_store.cc:276] 0503 07:58:26.699159 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.298956 (+2599797us) service_pool.cc:224] Handling call
0503 07:58:29.299170 (+ 214us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.299317 (+ 147us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.299337 (+ 20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.299374 (+ 37us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:29.299411 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.299456 (+ 45us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.299530 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:29.255421 28107 rpcz_store.cc:276] 0503 07:58:24.899836 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:24.899962 (+ 126us) service_pool.cc:224] Handling call
0503 07:58:24.923737 (+ 23775us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:26.200567 (+1276830us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.670988 (+2470421us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540016add4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.671250 (+ 262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790784896}
W20260503 07:58:29.273133 28104 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s user 0.007s sys 0.026s
I20260503 07:58:29.261231 28619 rpcz_store.cc:276] 0503 07:58:26.415143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.415342 (+ 199us) service_pool.cc:224] Handling call
0503 07:58:26.432190 (+ 16848us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.008799 (+576609us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:27.008843 (+ 44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:27.008900 (+ 57us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:27.008945 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.838126 (+1829181us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b540050df54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.838183 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.838316 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325581056}
I20260503 07:58:29.243083 30611 raft_consensus.cc:740] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
W20260503 07:58:29.268330 30664 log.cc:927] Time spent T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.975s user 0.010s sys 0.010s
I20260503 07:58:29.228576 30496 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:29.275069 28028 rpcz_store.cc:276] 0503 07:58:26.281573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.313285 (+ 31712us) service_pool.cc:224] Handling call
0503 07:58:26.321059 (+ 7774us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:26.788522 (+467463us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.858546 (+2070024us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001ef354. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.858787 (+ 241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557760384}
I20260503 07:58:29.314848 28028 raft_consensus.cc:1240] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:29.249732 28027 rpcz_store.cc:276] 0503 07:58:26.463347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.248471 (+2785124us) service_pool.cc:224] Handling call
0503 07:58:29.248711 (+ 240us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.248992 (+ 281us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.249028 (+ 36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.249075 (+ 47us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:29.249119 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.249170 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.249257 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:29.316509 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 450) took 2093 ms. Trace:
I20260503 07:58:29.316883 28027 rpcz_store.cc:276] 0503 07:58:27.222996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.315629 (+2092633us) service_pool.cc:224] Handling call
0503 07:58:29.315922 (+ 293us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.316140 (+ 218us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.316173 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.316222 (+ 49us) raft_consensus.cc:1645] Marking committed up to 8
0503 07:58:29.316272 (+ 50us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.316336 (+ 64us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.316450 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:29.318609 28027 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:29.243992 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:29.242497 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.319667 27958 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
W20260503 07:58:29.320096 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.320626 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1341) took 2029 ms. Trace:
I20260503 07:58:29.280498 28100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1549) took 1012 ms. Trace:
I20260503 07:58:29.321228 28100 rpcz_store.cc:276] 0503 07:58:28.268486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.327285 (+ 58799us) service_pool.cc:224] Handling call
0503 07:58:28.327469 (+ 184us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:28.458782 (+131313us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:28.458824 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:28.484641 (+ 25817us) log.cc:844] Serialized 26 byte log entry
0503 07:58:28.750065 (+265424us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:28.750106 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.750195 (+ 89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:29.280326 (+530131us) raft_consensus.cc:1685] finished
0503 07:58:29.280344 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.280449 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6378,"raft.queue_time_us":160495,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":25275,"thread_start_us":85217,"threads_started":1,"wal-append.queue_time_us":763179}
I20260503 07:58:28.784271 30524 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:29.281498 27960 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:29.083348 28106 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43222 (request call id 1663) took 2505 ms. Trace:
I20260503 07:58:29.290077 27854 catalog_manager.cc:5671] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
W20260503 07:58:29.297083 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 50485us
I20260503 07:58:29.300724 28614 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:28.862282 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2035) took 2579 ms. Trace:
I20260503 07:58:29.299633 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:29.303081 27954 raft_consensus.cc:2393] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:29.327912 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 448) took 2625 ms. Trace:
W20260503 07:58:29.344659 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 45085.9us
I20260503 07:58:29.344754 28029 rpcz_store.cc:276] 0503 07:58:26.702674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.299107 (+2596433us) service_pool.cc:224] Handling call
0503 07:58:29.327274 (+ 28167us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.327487 (+ 213us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.327521 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.327576 (+ 55us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:29.327636 (+ 60us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.327703 (+ 67us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.327850 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:29.341425 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.346100 28106 rpcz_store.cc:276] 0503 07:58:26.578292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.578484 (+ 192us) service_pool.cc:224] Handling call
0503 07:58:26.578762 (+ 278us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:27.092365 (+513603us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.083070 (+1990705us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54002ddcd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:29.083279 (+ 209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052006144}
I20260503 07:58:28.881287 30575 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:29.304113 28104 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s user 0.007s sys 0.026s
I20260503 07:58:29.348147 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:28.881390 30423 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.306008 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 449) took 2548 ms. Trace:
I20260503 07:58:29.306937 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:29.307459 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.307554 30611 consensus_queue.cc:260] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.308691 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.310104 28103 raft_consensus.cc:2410] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260503 07:58:29.310240 30652 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election won for term 5
W20260503 07:58:29.310120 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 70333.6us
W20260503 07:58:29.310482 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 227176us
I20260503 07:58:29.310705 30446 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:29.281337 30478 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.297883 30472 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.313385 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:28.862874 28035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43620 (request call id 446) took 2500 ms (client timeout 2455 ms). Trace:
I20260503 07:58:29.314967 28026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2040) took 3022 ms. Trace:
I20260503 07:58:29.320735 30459 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.244648 30557 consensus_queue.cc:237] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.266299 30675 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:29.042011 30228 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:29.249732 30558 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:28.761477 30377 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:29.354169 28104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1544) took 1097 ms. Trace:
W20260503 07:58:29.455123 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 635647us
I20260503 07:58:29.358906 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.351788 28033 rpcz_store.cc:276] 0503 07:58:26.283031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.120856 (+837825us) service_pool.cc:224] Handling call
0503 07:58:27.121253 (+ 397us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:27.149527 (+ 28274us) raft_consensus.cc:1534] Early marking committed up to index 4
0503 07:58:27.952239 (+802712us) log.cc:844] Serialized 14 byte log entry
0503 07:58:28.235466 (+283227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:28.235518 (+ 52us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:28.235567 (+ 49us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.862000 (+626433us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b54001ee954. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:28.862074 (+ 74us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:28.862216 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32986,"prepare.queue_time_us":1026131,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":20308,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":4762,"spinlock_wait_cycles":64504576,"thread_start_us":1015845,"threads_started":2,"wal-append.queue_time_us":310510,"wal-append.run_cpu_time_us":927,"wal-append.run_wall_time_us":1001380}
I20260503 07:58:29.458648 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:29.459981 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:29.291981 30644 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
W20260503 07:58:29.464545 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.362592 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.365835 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:29.466141 28029 raft_consensus.cc:2368] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5.
I20260503 07:58:29.322316 30547 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:29.312695 30522 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.323320 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.471276 28100 raft_consensus.cc:2393] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 8: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:29.302335 30374 consensus_queue.cc:1059] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260503 07:58:29.356134 30633 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.377740 28027 rpcz_store.cc:276] 0503 07:58:27.290853 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.317908 (+2027055us) service_pool.cc:224] Handling call
0503 07:58:29.318223 (+ 315us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.320414 (+ 2191us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.320557 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:29.298491 30591 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.378369 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2042) took 2509 ms. Trace:
I20260503 07:58:29.356521 30496 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:29.302100 30609 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.303813 30474 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.402418 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.286118 30552 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.361609 30575 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:29.437431 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.449673 30472 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:29.442783 28102 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 11.
I20260503 07:58:29.403565 28101 raft_consensus.cc:3055] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:29.383406 30556 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.450170 28614 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:29.451961 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.457489 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.494583 28101 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:29.415663 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.454901 28104 rpcz_store.cc:276] 0503 07:58:28.256599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.319503 (+ 62904us) service_pool.cc:224] Handling call
0503 07:58:28.319726 (+ 223us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:28.319896 (+ 170us) raft_consensus.cc:1534] Early marking committed up to index 4
0503 07:58:28.669673 (+349777us) log.cc:844] Serialized 14 byte log entry
0503 07:58:29.353763 (+684090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.353831 (+ 68us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:29.353902 (+ 71us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.353972 (+ 70us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.354105 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6087,"prepare.queue_time_us":541374,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":8906,"raft.run_wall_time_us":6923,"spinlock_wait_cycles":44864128,"thread_start_us":949741,"threads_started":2,"wal-append.queue_time_us":644300}
I20260503 07:58:29.422147 30277 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:29.416567 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.451705 30652 raft_consensus.cc:697] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:29.467440 30611 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:29.484658 30496 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:29.449399 30459 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.462795 30401 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.483708 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.451309 30423 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.454531 30228 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.473342 30415 consensus_queue.cc:1059] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260503 07:58:29.466291 30377 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.484831 30633 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.474063 30543 consensus_queue.cc:1059] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260503 07:58:29.468828 30644 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.526119 30543 raft_consensus.cc:3055] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:29.345358 27854 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:58:30.078960 30685 log.cc:927] Time spent T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.661s user 0.000s sys 0.010s
I20260503 07:58:29.376708 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.080798 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.364107 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.081975 27951 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:29.374787 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:29.351097 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.366830 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.093866 30575 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.094632 27957 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:29.372359 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.096062 30633 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.442540 28026 rpcz_store.cc:276] 0503 07:58:26.292693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:27.916900 (+1624207us) service_pool.cc:224] Handling call
0503 07:58:27.917324 (+ 424us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:27.917667 (+ 343us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:27.917695 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:27.918082 (+ 387us) log.cc:844] Serialized 26 byte log entry
0503 07:58:28.025535 (+107453us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:28.173752 (+148217us) log.cc:844] Serialized 14 byte log entry
0503 07:58:28.185347 (+ 11595us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:28.185438 (+ 91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:29.034987 (+849549us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b440002534c. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f8501593375 00007f8501593d92 00007f85042cf57b 00007f85042cae4f 00007f85042bec0e 00007f85042bdf56 00007f85042bdb78 00007f85042c75c1 00007f85042c7579 00007f85042c7509
0503 07:58:29.314746 (+279759us) raft_consensus.cc:1685] finished
0503 07:58:29.314820 (+ 74us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.314922 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21581,"prepare.queue_time_us":226870,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":12355,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":18518,"spinlock_wait_cycles":2454400,"thread_start_us":127961,"threads_started":2,"wal-append.queue_time_us":356695}
I20260503 07:58:29.481293 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:30.099004 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:30.100543 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:29.482362 28028 rpcz_store.cc:276] 0503 07:58:26.868960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.314454 (+2445494us) service_pool.cc:224] Handling call
0503 07:58:29.314702 (+ 248us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.378164 (+ 63462us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.378324 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:30.102159 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:29.479106 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:29.468039 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:30.112643 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:30.113507 28029 raft_consensus.cc:2393] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:30.113610 28033 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 11.
I20260503 07:58:30.114073 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:29.403189 28032 rpcz_store.cc:276] 0503 07:58:26.758155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.305305 (+2547150us) service_pool.cc:224] Handling call
0503 07:58:29.305520 (+ 215us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:29.305721 (+ 201us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.305746 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:29.305796 (+ 50us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:29.305833 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:29.305883 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:29.305965 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:30.114534 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:30.114713 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:30.115612 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:29.441345 28035 rpcz_store.cc:269] 0503 07:58:26.362169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:26.772793 (+410624us) service_pool.cc:224] Handling call
0503 07:58:28.862650 (+2089857us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540024bdd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:28.862774 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827277696}
I20260503 07:58:29.475476 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.496435 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:29.441632 28105 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:29.466398 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.123770 28106 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:29.513382 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.124817 30552 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:29.526930 30377 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:29.526911 30472 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.924794 30459 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.922067 30423 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:29.934636 30474 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:29.915537 30228 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:29.918979 30401 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.521420 30496 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:29.909531 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:29.514654 30277 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.940722 30524 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:29.925544 28107 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:29.908535 28613 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:29.522850 30591 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.135098 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:29.576339 30609 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.495697 28101 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:29.661561 30652 consensus_queue.cc:237] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.501533 30656 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:30.138417 28101 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:30.139492 30524 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.414433 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:29.575237 30667 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.505163 30671 consensus_queue.cc:1048] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260503 07:58:29.493319 30675 consensus_queue.cc:1059] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
W20260503 07:58:29.904592 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 417558us
W20260503 07:58:29.927901 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:29.926374 30599 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:29.908418 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:29.966845 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 457742us
I20260503 07:58:29.942871 30446 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:29.509248 30556 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:29.937781 27952 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
W20260503 07:58:29.914011 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:29.837317 27956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s user 0.008s sys 0.023s
I20260503 07:58:29.911574 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:29.916383 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.038020 30614 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:30.121025 30690 log.cc:927] Time spent T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.585s user 0.004s sys 0.006s
I20260503 07:58:30.068154 28109 raft_consensus.cc:1240] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:30.089869 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.089815 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.091544 30559 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.091470 30543 raft_consensus.cc:740] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:30.092444 30522 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.092970 30478 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:29.362396 27960 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: []
W20260503 07:58:30.090983 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.110489 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:30.163543 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:30.164089 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.164443 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:30.164759 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.117334 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:30.115489 28029 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:30.192144 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:30.192260 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:30.193245 30700 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260503 07:58:30.193619 28029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:30.194375 28029 raft_consensus.cc:606] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:30.115535 28033 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:30.108896 30672 raft_consensus.cc:3055] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:30.194967 30672 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:30.196213 30672 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.197386 30672 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:30.136868 30277 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:30.122990 30644 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:29.868861 28030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s user 0.013s sys 0.028s
W20260503 07:58:30.199214 28030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s user 0.023s sys 0.038s
I20260503 07:58:30.199355 28028 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:30.200184 28030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1339) took 3641 ms. Trace:
W20260503 07:58:30.149487 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.200814 28028 raft_consensus.cc:1275] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260503 07:58:30.201541 28028 pending_rounds.cc:85] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 4
I20260503 07:58:30.201921 28028 pending_rounds.cc:107] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260503 07:58:30.200551 28030 rpcz_store.cc:276] 0503 07:58:26.558952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.272679 (+2713727us) service_pool.cc:224] Handling call
0503 07:58:29.294210 (+ 21531us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:29.294571 (+ 361us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.294607 (+ 36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:29.295103 (+ 496us) log.cc:844] Serialized 26 byte log entry
0503 07:58:30.199716 (+904613us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:30.199770 (+ 54us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.199846 (+ 76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:30.199895 (+ 49us) raft_consensus.cc:1685] finished
0503 07:58:30.199905 (+ 10us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:30.200119 (+ 214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1947,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7478,"thread_start_us":839180,"threads_started":1,"wal-append.queue_time_us":732048}
I20260503 07:58:30.202265 28028 raft_consensus.cc:2889] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:30.203301 28030 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: []
W20260503 07:58:30.149677 27956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s user 0.014s sys 0.031s
I20260503 07:58:30.145455 30599 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.205215 30277 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:30.205852 30277 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.206240 28035 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:30.206640 30599 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.150082 28102 raft_consensus.cc:2468] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:30.147825 28583 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:30.207669 30522 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.208019 30277 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:30.208587 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 61008.1us
I20260503 07:58:30.116948 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:30.209925 28032 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:30.212242 28032 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260503 07:58:30.213521 30694 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:30.213927 30694 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.214313 30694 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:30.155009 30415 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:30.173578 30680 log.cc:927] Time spent T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.859s user 0.007s sys 0.005s
I20260503 07:58:30.215238 30415 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.208429 30522 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.217424 30415 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.158388 28109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1550) took 1889 ms. Trace:
I20260503 07:58:30.218041 28109 rpcz_store.cc:276] 0503 07:58:28.268651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.328862 (+ 60211us) service_pool.cc:224] Handling call
0503 07:58:28.329167 (+ 305us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:30.157313 (+1828146us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.158078 (+ 765us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000a6754. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:30.158302 (+ 224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3989147520}
I20260503 07:58:30.219300 30522 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.167785 28027 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:30.147437 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.152530 28101 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:30.161670 30543 consensus_queue.cc:260] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.144670 30582 raft_consensus.cc:3055] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Stepping down as leader of term 4
W20260503 07:58:30.161170 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.121285 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.153527 30614 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.228313 28108 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 3.
I20260503 07:58:30.230064 30614 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.159358 30559 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.232206 30559 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:30.148290 30446 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.156378 27952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45176 (request call id 1647) took 1029 ms. Trace:
I20260503 07:58:30.158943 27954 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:30.156235 30556 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.233070 30582 raft_consensus.cc:740] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:30.154824 30591 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.235432 30591 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.236188 30446 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.236076 30582 consensus_queue.cc:260] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:30.140630 30471 consensus_meta.cc:287] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.890s user 0.005s sys 0.011s
I20260503 07:58:30.239259 30377 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:30.239362 30591 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:30.162096 30688 log.cc:927] Time spent T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.605s user 0.002s sys 0.008s
I20260503 07:58:30.225718 28583 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:30.233114 27952 rpcz_store.cc:276] 0503 07:58:29.126654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.229418 (+102764us) service_pool.cc:224] Handling call
0503 07:58:30.156176 (+926758us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54001a18d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:30.156323 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395862400}
I20260503 07:58:30.142151 30524 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.245252 28027 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:30.200529 28585 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:30.248503 28027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
I20260503 07:58:30.250854 30582 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.239717 30377 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:30.256325 30519 consensus_meta.cc:287] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.993s user 0.013s sys 0.010s
W20260503 07:58:30.260619 30673 consensus_meta.cc:287] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.958s user 0.013s sys 0.021s
I20260503 07:58:30.261441 30667 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:30.287427 30496 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:30.288458 30611 consensus_meta.cc:287] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.766s user 0.012s sys 0.005s
I20260503 07:58:30.289186 28617 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
W20260503 07:58:30.292407 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 338665us
I20260503 07:58:30.262216 27956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41856 (request call id 340) took 1071 ms. Trace:
W20260503 07:58:30.262899 30547 consensus_meta.cc:287] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.791s user 0.009s sys 0.009s
I20260503 07:58:30.263031 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.264587 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1342) took 2311 ms. Trace:
I20260503 07:58:30.264480 28583 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:30.268354 30377 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.274652 28028 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260503 07:58:30.249513 28027 raft_consensus.cc:606] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:30.295740 28035 rpcz_store.cc:276] 0503 07:58:27.955263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:30.136486 (+2181223us) service_pool.cc:224] Handling call
0503 07:58:30.136929 (+ 443us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:30.206672 (+ 69743us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.264318 (+ 57646us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b5400280fd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:30.264502 (+ 184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158139136}
I20260503 07:58:30.297909 28027 raft_consensus.cc:614] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:30.303798 28030 raft_consensus.cc:1240] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
W20260503 07:58:30.252954 30574 consensus_meta.cc:287] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 1.011s user 0.016s sys 0.019s
I20260503 07:58:30.317555 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.317992 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.319036 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.319326 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.320161 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.320202 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.320360 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.321641 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.322768 27955 raft_consensus.cc:2393] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:30.293632 27956 rpcz_store.cc:276] 0503 07:58:29.190656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.278659 (+ 88003us) service_pool.cc:224] Handling call
0503 07:58:29.278938 (+ 279us) raft_consensus.cc:1471] Updating replica for 2 ops
0503 07:58:29.304996 (+ 26058us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:29.305049 (+ 53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0503 07:58:29.305493 (+ 444us) log.cc:844] Serialized 52 byte log entry
0503 07:58:30.204718 (+899225us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:30.204804 (+ 86us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.204935 (+ 131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:30.261917 (+ 56982us) raft_consensus.cc:1685] finished
0503 07:58:30.261941 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:30.262157 (+ 216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25689,"raft.queue_time_us":30785,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":895174,"threads_started":1,"wal-append.queue_time_us":162448}
I20260503 07:58:30.256853 30519 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.330490 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.331372 30611 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:30.331820 30611 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.314848 30472 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:30.332248 30611 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:30.336505 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.301821 30478 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:30.327461 28026 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
W20260503 07:58:30.328703 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 154614us
I20260503 07:58:30.301471 30673 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.315243 30644 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:30.337594 30478 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.341755 27926 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:30.342476 30667 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260503 07:58:30.342628 30618 consensus_meta.cc:287] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 1.088s user 0.011s sys 0.011s
W20260503 07:58:30.343084 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 142677us
I20260503 07:58:30.332484 30472 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.345553 30629 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:30.345220 30694 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.347342 30673 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.341771 28034 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:30.349409 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:30.350132 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 85861.6us
I20260503 07:58:30.357563 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.364002 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1345) took 2406 ms. Trace:
I20260503 07:58:30.364784 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.365772 30607 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:30.365612 30644 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.358251 30667 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:30.371265 30582 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:30.372581 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1343) took 2417 ms. Trace:
I20260503 07:58:30.374706 28104 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:30.374895 28620 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:30.375474 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:30.371811 30582 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.374832 28033 rpcz_store.cc:276] 0503 07:58:27.955536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:30.195183 (+2239647us) service_pool.cc:224] Handling call
0503 07:58:30.195644 (+ 461us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:30.196090 (+ 446us) raft_consensus.cc:1534] Early marking committed up to index 4
0503 07:58:30.245453 (+ 49363us) log.cc:844] Serialized 14 byte log entry
0503 07:58:30.371855 (+126402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:30.371914 (+ 59us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:30.371982 (+ 68us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.372051 (+ 69us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:30.372529 (+ 478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7114,"prepare.queue_time_us":48435,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":51,"raft.queue_time_us":7436,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":163894,"threads_started":2}
I20260503 07:58:30.377393 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:30.376194 30519 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.380178 28585 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:30.378086 30582 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.381816 27960 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:30.375047 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.367619 30667 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.384958 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.385222 30614 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:30.384871 30652 consensus_queue.cc:1059] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260503 07:58:30.386026 30702 log.cc:927] Time spent T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.139s user 0.001s sys 0.000s
I20260503 07:58:30.385906 30614 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.386780 30478 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.390034 30695 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:30.390475 30478 raft_consensus.cc:3055] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:30.390585 30695 raft_consensus.cc:697] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:30.390724 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.390941 30478 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:30.391500 28107 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:30.391762 30695 consensus_queue.cc:237] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.392128 30478 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.393407 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.394088 28618 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:30.394722 27954 raft_consensus.cc:1240] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:30.394769 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.383299 30671 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:30.396906 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:30.362906 30618 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.365082 28029 rpcz_store.cc:276] 0503 07:58:27.956008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:30.198226 (+2242218us) service_pool.cc:224] Handling call
0503 07:58:30.198587 (+ 361us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:30.198847 (+ 260us) raft_consensus.cc:1534] Early marking committed up to index 4
0503 07:58:30.316094 (+117247us) log.cc:844] Serialized 14 byte log entry
0503 07:58:30.359691 (+ 43597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:30.359750 (+ 59us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:30.362077 (+ 2327us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.362151 (+ 74us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:30.362279 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2030,"prepare.queue_time_us":46021,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":23609,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1626,"thread_start_us":125570,"threads_started":2}
I20260503 07:58:30.368160 30524 consensus_queue.cc:1059] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260503 07:58:30.425895 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 65184us
I20260503 07:58:30.390477 30614 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.426115 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.513731 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:30.440316 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.450611 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.457671 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.448764 28031 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:30.517726 27954 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:30.520707 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.450855 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.403788 30694 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.447981 28035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
mode: GRACEFUL
new_leader_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:40278
W20260503 07:58:30.496245 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 66196.7us
I20260503 07:58:30.524410 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:30.525749 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:30.526429 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.524919 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.451258 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.530488 28035 raft_consensus.cc:606] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Received request to transfer leadership to TS 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:30.529110 27956 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:30.533032 28107 raft_consensus.cc:2393] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 6: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:30.457232 30478 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:30.537766 27957 raft_consensus.cc:2393] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:30.429534 30496 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.430145 30673 raft_consensus.cc:3055] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:30.510475 30474 consensus_queue.cc:1059] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260503 07:58:30.449769 30472 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.543458 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1328) took 4229 ms. Trace:
I20260503 07:58:30.588330 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.544945 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.589357 27960 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:30.545404 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.546514 27957 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:30.546922 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2055) took 1205 ms. Trace:
I20260503 07:58:30.547731 28104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43222 (request call id 1687) took 1235 ms. Trace:
I20260503 07:58:30.548374 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1334) took 4146 ms. Trace:
W20260503 07:58:30.548907 27923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.549453 27958 raft_consensus.cc:2393] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:30.561411 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.561568 28105 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:30.555478 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.583142 28102 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:30.559571 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.586925 28026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33294 (request call id 2048) took 1201 ms. Trace:
I20260503 07:58:30.518641 30607 raft_consensus.cc:697] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:30.530009 30543 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:30.544220 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:30.595665 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 51600.7us
I20260503 07:58:30.596628 30614 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260503 07:58:30.597101 30614 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.597522 30614 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:30.602788 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.605366 30524 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:30.605736 30524 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.606087 30524 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:30.590683 28028 rpcz_store.cc:276] 0503 07:58:29.341371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:30.203985 (+862614us) service_pool.cc:224] Handling call
0503 07:58:30.274356 (+ 70371us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:30.303644 (+ 29288us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.546726 (+243082us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b5400280fd0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f8504723c8d 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:30.546851 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154832640}
I20260503 07:58:30.560446 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.588071 28031 rpcz_store.cc:276] 0503 07:58:26.314482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.489551 (+2175069us) service_pool.cc:224] Handling call
0503 07:58:28.515831 (+ 26280us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:30.539647 (+2023816us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.543205 (+ 3558us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54002396d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:30.543397 (+ 192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4442178304}
I20260503 07:58:30.562878 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.592113 28034 rpcz_store.cc:276] 0503 07:58:26.401736 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.510779 (+2109043us) service_pool.cc:224] Handling call
0503 07:58:28.510963 (+ 184us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:30.367642 (+1856679us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:30.548178 (+180536us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540024d1d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:30.548326 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4207634688}
I20260503 07:58:30.609606 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.591492 28104 rpcz_store.cc:276] 0503 07:58:29.312801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:29.496003 (+183202us) service_pool.cc:224] Handling call
0503 07:58:30.547535 (+1051532us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000190d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:30.547659 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368309120}
I20260503 07:58:30.616418 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.617064 28104 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:30.557360 30644 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.556597 30618 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.617884 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.558825 30611 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.618542 28104 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:30.618868 27953 raft_consensus.cc:3055] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:30.619191 27953 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:30.619374 28100 raft_consensus.cc:2393] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 10: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:30.619725 30611 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.619899 27953 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.617323 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.621259 28107 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
W20260503 07:58:30.621608 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 90512.4us
I20260503 07:58:30.607894 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.594491 28026 rpcz_store.cc:276] 0503 07:58:29.339279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:30.113792 (+774513us) service_pool.cc:224] Handling call
0503 07:58:30.540470 (+426678us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54002823d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:30.540602 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482993024}
I20260503 07:58:30.612082 30582 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:30.617251 28103 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
I20260503 07:58:30.624362 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.626050 28106 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 4.
W20260503 07:58:30.626573 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.576782 30673 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:30.631335 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.617969 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.635362 27960 raft_consensus.cc:1240] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:30.638665 30582 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.639966 28073 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.640519 30582 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:30.640748 30672 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:30.641209 30672 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:30.641605 30672 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:30.643994 30703 log.cc:927] Time spent T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.293s user 0.000s sys 0.002s
I20260503 07:58:30.644798 30611 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:30.645113 27953 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:30.645186 30611 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.645730 30611 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:30.647826 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.639853 30673 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:30.650049 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 207484us
I20260503 07:58:30.650424 30673 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:30.633318 30547 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.652848 30547 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:30.653311 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.650637 28105 raft_consensus.cc:2410] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260503 07:58:30.660825 27924 connection.cc:254] RPC call timeout handler was delayed by -1.6273718310000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260503 07:58:30.661456 30607 consensus_queue.cc:237] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
W20260503 07:58:30.662040 27924 connection.cc:254] RPC call timeout handler was delayed by -1.4671718309999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260503 07:58:30.662379 27924 connection.cc:254] RPC call timeout handler was delayed by -1.4194718310000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260503 07:58:30.662729 27924 connection.cc:254] RPC call timeout handler was delayed by -1.4014718309999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260503 07:58:30.663022 27924 connection.cc:254] RPC call timeout handler was delayed by -1.3213718309999649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260503 07:58:30.663291 27924 connection.cc:254] RPC call timeout handler was delayed by -1.2700718309999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260503 07:58:30.657461 27955 raft_consensus.cc:3055] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:30.668625 27955 raft_consensus.cc:740] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:30.668843 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.671803 28108 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
W20260503 07:58:30.671947 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.668853 30611 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.683701 30611 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.684841 27924 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:30.673087 27953 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260503 07:58:30.705828 28073 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:30.706573 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.695997 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:30.708443 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.664788 30614 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.695847 30716 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:30.675300 30547 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:30.719267 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.676232 30524 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:30.720988 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.720804 30582 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:30.723049 27955 consensus_queue.cc:260] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:30.736999 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 52252.8us
I20260503 07:58:30.734758 30582 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:30.739078 30582 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.739521 28073 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.740980 30614 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.749157 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.742468 30629 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:30.738716 30719 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:30.752841 27924 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:30.754878 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.756114 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.757004 27955 raft_consensus.cc:3060] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.760828 30672 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.762511 30716 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:30.762794 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:30.763284 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.763409 27957 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.764250 30557 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:30.764663 30557 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:30.761323 28616 raft_consensus.cc:2368] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
I20260503 07:58:30.764842 28073 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.765053 30557 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:30.766286 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.766551 30524 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.767231 30543 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:30.767607 30543 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:30.767943 30543 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:30.768795 30374 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:30.769187 30374 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:30.769475 30374 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:30.762902 30672 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.777273 30667 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.784479 30719 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.789161 30611 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:30.789778 30611 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:30.790138 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.779422 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.795087 30611 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:30.802348 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 112835us
I20260503 07:58:30.805815 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.806818 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.804364 30672 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260503 07:58:30.807706 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.808408 30519 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:30.808825 30519 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:30.809235 30519 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:30.810822 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.810549 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.811827 27951 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:30.812788 27959 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
W20260503 07:58:30.815153 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.812705 30611 raft_consensus.cc:2764] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260503 07:58:30.813762 30524 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:30.820499 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.822840 28105 raft_consensus.cc:2410] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260503 07:58:30.821261 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:30.820851 27856 catalog_manager.cc:5671] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 3 to 4, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 4 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:30.824349 28109 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.824697 28106 raft_consensus.cc:1240] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:30.826586 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:30.827082 28101 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:30.829337 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.830022 28106 raft_consensus.cc:2393] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 10: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:30.830204 30524 raft_consensus.cc:697] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:30.831158 30524 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.832273 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.832363 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.832898 28103 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:30.833315 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:30.833886 28105 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:30.834477 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.834596 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.835017 28106 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:30.835160 28103 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:30.821846 30582 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.839643 28101 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:30.841356 28109 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:30.841357 27955 raft_consensus.cc:1275] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260503 07:58:30.842664 30472 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260503 07:58:30.843459 30582 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:30.850692 30474 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:30.853374 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.854039 27958 raft_consensus.cc:2393] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 10: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:30.856506 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.857107 27960 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:30.860334 30582 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:30.863023 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:30.864367 28075 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:30.865171 30591 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:30.865521 30591 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.865593 27960 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:30.865950 30591 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:30.867856 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.869534 28105 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:30.847116 30719 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.847589 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.847783 30667 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:30.848342 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:30.872080 27957 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:30.868538 28583 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:30.816473 30673 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:30.874046 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.876173 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.881662 27955 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 8
I20260503 07:58:30.881592 27960 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:30.882798 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.884245 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.884752 27959 raft_consensus.cc:2393] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 7: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:30.886885 27958 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:30.886771 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.889535 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.890450 28105 raft_consensus.cc:2410] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260503 07:58:30.875995 30582 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:30.892534 28033 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:30.893340 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.891701 28583 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:30.881369 30673 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.889158 30496 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:30.895227 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.901274 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:30.901829 28107 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:30.898347 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:30.898471 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 80935.2us
I20260503 07:58:30.897904 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.900612 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.902627 27951 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:30.903430 28583 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:30.909570 28102 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260503 07:58:30.910503 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.911103 28106 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:30.911831 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:30.912401 28103 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:30.901103 30673 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:30.905071 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:30.894590 30582 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:30.918417 30504 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:30.918855 30504 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:30.919184 30504 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.920109 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 318) took 2159 ms. Trace:
I20260503 07:58:30.918479 30582 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:30.921471 28101 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:30.923733 28103 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:30.901692 28109 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:30.927352 27958 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:30.927901 30607 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:30.929579 30695 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:30.921371 27856 catalog_manager.cc:5671] T 4029065128b84be9a45c0bfe2af75b6f P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:30.930048 30695 raft_consensus.cc:697] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:30.930984 30695 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.930948 27856 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 5 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:30.904350 27924 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.934947 28107 raft_consensus.cc:2410] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260503 07:58:30.936085 30543 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.937980 30543 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.939424 28619 raft_consensus.cc:1240] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:30.939522 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.940188 28622 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:30.940145 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.941443 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.942662 30582 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.943712 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.944433 30582 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.944445 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.920425 27854 rpcz_store.cc:276] 0503 07:58:28.760988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:28.761251 (+ 263us) service_pool.cc:224] Handling call
0503 07:58:30.919949 (+2158698us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:30.271736 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:30.272544 (+ 808us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:30.272598 (+ 54us) write_op.cc:435] Acquired schema lock
0503 07:58:30.272636 (+ 38us) tablet.cc:662] Decoding operations
0503 07:58:30.273255 (+ 619us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:30.273360 (+ 105us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:30.273416 (+ 56us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:58:30.273935 (+ 519us) tablet.cc:701] Row locks acquired
0503 07:58:30.273990 (+ 55us) write_op.cc:260] PREPARE: finished
0503 07:58:30.274167 (+ 177us) write_op.cc:270] Start()
0503 07:58:30.274289 (+ 122us) write_op.cc:276] Timestamp: P: 1777795110274116 usec, L: 0
0503 07:58:30.274345 (+ 56us) op_driver.cc:348] REPLICATION: starting
0503 07:58:30.275150 (+ 805us) log.cc:844] Serialized 973 byte log entry
0503 07:58:30.557413 (+282263us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800086c20. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:58:30.661309 (+103896us) op_driver.cc:464] REPLICATION: finished
0503 07:58:30.733729 (+ 72420us) write_op.cc:301] APPLY: starting
0503 07:58:30.735898 (+ 2169us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:30.744413 (+ 8515us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:30.744446 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:30.744937 (+ 491us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:30.745256 (+ 319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:58:30.745308 (+ 52us) write_op.cc:312] APPLY: finished
0503 07:58:30.745612 (+ 304us) log.cc:844] Serialized 29 byte log entry
0503 07:58:30.745803 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:30.745885 (+ 82us) write_op.cc:454] Released schema lock
0503 07:58:30.745940 (+ 55us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:30.746377 (+ 437us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:30.746404 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":65129,"apply.run_cpu_time_us":2311,"apply.run_wall_time_us":19628,"num_ops":2,"prepare.queue_time_us":171035,"prepare.run_cpu_time_us":8870,"prepare.run_wall_time_us":110199,"raft.queue_time_us":101658,"raft.run_cpu_time_us":25456,"raft.run_wall_time_us":47827,"replication_time_us":386797,"spinlock_wait_cycles":24835968,"thread_start_us":327671,"threads_started":4,"wal-append.queue_time_us":126178}]]}
I20260503 07:58:30.946417 30673 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.947670 28105 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 11: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:30.948370 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.949677 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.949846 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.951169 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.951987 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.952543 27953 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
W20260503 07:58:30.953193 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 58287.3us
I20260503 07:58:30.954196 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:30.948905 27959 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 11
I20260503 07:58:30.957031 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.959131 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:30.959856 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:30.961640 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:30.956899 30639 raft_consensus.cc:2764] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260503 07:58:30.962710 30729 log.cc:927] Time spent T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
W20260503 07:58:30.969074 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4307962210000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260503 07:58:30.969183 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:30.969413 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4001962209999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260503 07:58:30.969828 27954 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:30.971585 30557 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.974629 30730 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:30.976249 28619 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:30.977162 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.978289 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:30.978909 27952 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:30.979547 27924 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.980780 30474 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:30.980815 27924 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.980973 30713 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260503 07:58:30.986596 30474 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:30.987046 30474 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:30.985250 30714 consensus_queue.cc:1059] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260503 07:58:30.988540 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:30.983734 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:30.989400 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:30.990142 28618 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 5: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:30.980885 30591 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.989894 30639 consensus_queue.cc:1059] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260503 07:58:30.989836 30607 raft_consensus.cc:3055] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:30.991014 30607 raft_consensus.cc:740] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:30.991169 30472 raft_consensus.cc:3055] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:30.991667 30472 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:30.991824 30591 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:30.991762 30607 consensus_queue.cc:260] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.992826 30607 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:30.992470 30472 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:30.993983 30472 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:30.989531 28622 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:30.983466 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:30.997578 30504 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:30.998973 28026 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:31.000054 30504 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:31.000886 30667 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:31.001318 30673 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:31.002095 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.003088 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.023025 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.023496 27958 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.003456 30374 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.004346 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.023010 27953 raft_consensus.cc:3055] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:31.004936 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:31.024871 28108 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 9: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:31.005609 27955 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:31.006560 30557 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:31.028064 30374 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:31.006695 30519 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.030028 28033 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:31.030820 30519 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:31.006683 30716 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:31.031828 30716 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:31.006969 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:31.032225 30716 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:31.008036 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.032842 28613 raft_consensus.cc:2393] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:31.008646 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.009285 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:31.011723 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.010057 27959 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 11.
I20260503 07:58:31.034257 30496 consensus_queue.cc:1059] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:31.006248 27924 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.035300 30504 raft_consensus.cc:3055] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:31.017810 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.035558 30714 raft_consensus.cc:2764] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260503 07:58:31.035657 30504 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:30.978274 28101 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 11.
I20260503 07:58:31.019387 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.003330 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.024863 27953 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:30.922250 30377 consensus_queue.cc:1048] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260503 07:58:31.016543 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.036417 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.042956 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
W20260503 07:58:31.046922 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.017318 27952 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 11.
I20260503 07:58:31.049795 27953 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.051718 27958 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
W20260503 07:58:31.052906 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 83081.8us
I20260503 07:58:31.053180 28583 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:31.055006 27953 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:31.054677 27924 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.052848 30714 raft_consensus.cc:2764] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260503 07:58:31.060185 30713 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:31.061926 27924 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.062880 30713 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:31.063314 30713 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.056558 30374 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:31.069222 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.069790 30713 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.070331 28073 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.057106 30695 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:31.073134 30719 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:31.076073 30719 raft_consensus.cc:697] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:31.060539 30504 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.073635 30374 raft_consensus.cc:2764] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260503 07:58:31.083702 27953 raft_consensus.cc:1275] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:31.076936 30557 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:31.076445 30695 raft_consensus.cc:697] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:31.087090 30504 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:31.079459 30719 consensus_queue.cc:237] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:31.092521 27999 connection.cc:254] RPC call timeout handler was delayed by -1.332696220999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260503 07:58:31.093046 27999 connection.cc:254] RPC call timeout handler was delayed by -1.2750962210000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260503 07:58:31.092463 30695 consensus_queue.cc:237] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.093804 30713 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:31.093348 27999 connection.cc:254] RPC call timeout handler was delayed by -1.266096220999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260503 07:58:31.095708 30667 consensus_queue.cc:1048] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:31.095906 28073 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:31.096330 27924 leader_election.cc:400] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367) with higher term. Message: Invalid argument: T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
I20260503 07:58:31.108273 27924 leader_election.cc:403] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:31.112298 30719 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367) with higher term. Message: Invalid argument: T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8.
W20260503 07:58:31.115061 27999 connection.cc:254] RPC call timeout handler was delayed by -1.0743962210000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260503 07:58:31.115594 30519 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:31.115655 28617 raft_consensus.cc:1240] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:31.116048 30519 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
W20260503 07:58:31.117477 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.117700 30519 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:31.119963 30557 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:31.119846 30713 consensus_queue.cc:1059] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260503 07:58:31.120316 30557 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:31.120668 30557 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.120764 30713 raft_consensus.cc:3055] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:31.121376 30713 raft_consensus.cc:740] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:31.122458 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.122251 30713 consensus_queue.cc:260] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.123894 30713 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:31.133184 28073 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:31.104983 30716 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.134209 28073 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.135802 30716 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:31.136371 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:31.141261 30374 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:31.141986 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.142382 30519 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:31.142733 30377 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:31.143052 28073 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.142833 30519 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.143662 30673 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:31.144165 30673 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.143167 30377 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:31.145080 30377 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.142007 30374 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:31.145999 30673 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:31.144634 30519 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:31.147428 30474 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.148125 27855 catalog_manager.cc:5671] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
W20260503 07:58:31.149755 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.140515 30557 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.155622 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:31.157209 30374 raft_consensus.cc:3060] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:31.157461 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:31.157608 27855 catalog_manager.cc:5671] T 55c91f6091bd409db505153a1d4c7531 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.174083 28105 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:31.176983 27954 raft_consensus.cc:1240] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:31.164215 30377 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.180743 28101 raft_consensus.cc:2393] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:31.181506 27855 catalog_manager.cc:5671] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.184504 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:31.185292 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.186578 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.187500 28103 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:31.188287 27855 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 10 to 11, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 11 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.191932 27855 catalog_manager.cc:5671] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 7 to 8, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 8 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.193775 27855 catalog_manager.cc:5671] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:31.196763 30557 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:31.202950 30474 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:31.204406 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:31.204556 30377 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:31.206092 30519 raft_consensus.cc:993] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:31.206552 30519 raft_consensus.cc:1081] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:31.207270 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.208031 30524 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:31.208426 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.209159 30673 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:31.211154 30496 consensus_queue.cc:1059] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:31.212126 30496 raft_consensus.cc:3055] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:31.212455 30496 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:31.213266 30496 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.214502 30496 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.224511 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.224812 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.225320 30673 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:31.225529 28108 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:31.228811 28108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:56100
I20260503 07:58:31.229305 28108 raft_consensus.cc:606] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:31.230538 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.231052 28101 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.231997 28073 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.232770 30543 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:31.232731 30591 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260503 07:58:31.233274 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.234162 28073 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.234966 30582 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:31.236011 28073 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.237633 30543 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260503 07:58:31.238153 30543 raft_consensus.cc:697] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 11 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:31.238534 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.239008 30543 consensus_queue.cc:237] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.240607 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.244791 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.245368 27954 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:31.246362 30374 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:31.246462 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.251281 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:31.254379 28101 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:31.255741 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:31.257027 30730 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:31.257269 28583 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.256727 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:31.257522 30730 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.260038 30730 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:31.258460 30504 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.261725 28583 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.261904 28101 raft_consensus.cc:1275] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:31.263142 28105 raft_consensus.cc:2468] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:31.264935 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:31.265542 28102 raft_consensus.cc:1275] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:31.265973 28108 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:31.236821 30673 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:31.269855 28103 raft_consensus.cc:2410] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260503 07:58:31.273998 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:31.276515 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:31.277396 28106 raft_consensus.cc:1275] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:31.277329 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:31.276859 28100 raft_consensus.cc:1240] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:31.269299 30667 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:31.279524 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:31.277719 28109 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:31.284672 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.292714 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:31.293540 28101 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 6: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:58:31.294510 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.304477 30667 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:31.317291 30667 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.321486 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.322958 30519 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:31.323068 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:31.323598 30519 raft_consensus.cc:993] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413: : Instructing follower 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:31.316497 28107 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:31.307111 30673 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:31.332962 27953 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:31.333427 27954 raft_consensus.cc:2468] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:31.335641 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.338253 28100 raft_consensus.cc:2393] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:31.343317 28100 raft_consensus.cc:1275] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:31.345141 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.346208 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:31.346773 30667 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:31.334380 30524 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:31.348140 30524 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:31.348584 30524 raft_consensus.cc:3060] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:31.349504 28101 raft_consensus.cc:1240] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:31.351289 27856 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 3 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.354795 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:31.362525 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:31.334996 30611 raft_consensus.cc:1081] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Signalling peer 37e72845941344c9b0aaa7235a6f4473 to start an election
I20260503 07:58:31.371454 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.372709 30694 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:31.355983 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:31.352950 27856 catalog_manager.cc:5671] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 3 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.384377 27856 catalog_manager.cc:5671] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 5 to 6, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 6 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.387143 30714 consensus_queue.cc:1048] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:31.388289 30504 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:31.394126 28583 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.398232 28107 raft_consensus.cc:1240] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:31.399108 27954 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:31.406631 28583 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:31.405614 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:31.410036 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.412433 30695 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:31.411993 28617 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:31.414528 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:31.415820 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:31.404457 30673 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:31.412815 30695 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:31.418500 28073 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.417995 30519 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:31.397322 30474 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260503 07:58:31.421082 30524 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.425328 30639 consensus_queue.cc:1059] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:31.409569 30496 raft_consensus.cc:2804] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:31.446800 30496 raft_consensus.cc:697] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:31.447702 30496 consensus_queue.cc:237] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.428593 30519 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:31.449369 30519 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:31.449062 28613 consensus_queue.cc:237] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.437952 30716 consensus_queue.cc:1048] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260503 07:58:31.454181 30524 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:31.455478 30672 raft_consensus.cc:2804] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:31.416779 30730 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:31.428565 30695 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.418798 30719 consensus_queue.cc:1059] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260503 07:58:31.429189 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.467201 27924 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:31.401089 30713 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260503 07:58:31.438644 30749 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:31.469573 30749 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:31.469884 30749 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:31.455921 30672 raft_consensus.cc:697] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:31.473196 30472 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:31.473062 30672 consensus_queue.cc:237] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.473989 30713 consensus_queue.cc:1059] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:31.410956 30714 consensus_queue.cc:1048] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260503 07:58:31.475680 30716 raft_consensus.cc:3055] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:31.476060 30716 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:31.476508 28026 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260503 07:58:31.457005 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:31.465243 30519 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.469158 28107 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:31.473398 30644 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:31.485489 30719 raft_consensus.cc:3055] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:31.446288 30639 raft_consensus.cc:3055] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:31.485944 30719 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:31.486809 30639 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:31.442577 30752 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:31.476768 30716 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.483366 27857 catalog_manager.cc:5671] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 7, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:31.489549 28101 raft_consensus.cc:1275] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260503 07:58:31.491994 27857 catalog_manager.cc:5671] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 4 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:31.490335 30524 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:31.498451 30524 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:31.498805 30524 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:31.487514 30639 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.492544 30472 consensus_queue.cc:1059] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260503 07:58:31.500998 30639 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:31.501319 30716 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:31.487464 30719 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.487998 30504 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260503 07:58:31.509037 30719 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:31.484519 30749 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.490119 28073 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:31.519572 30694 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:31.521292 30543 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:31.521971 30543 raft_consensus.cc:697] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:31.523126 30474 raft_consensus.cc:3055] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:31.523533 30474 raft_consensus.cc:740] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:31.523008 30543 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.524224 30474 consensus_queue.cc:260] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.525504 30474 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:31.497288 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:31.497790 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.500187 27857 catalog_manager.cc:5671] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 2 to 5, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 5 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:31.529850 27857 catalog_manager.cc:5671] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 8, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 8 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:31.531802 27857 catalog_manager.cc:5671] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 8 to 9, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:31.534888 27857 catalog_manager.cc:5671] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 8 to 9, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:31.539938 30524 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.542060 30524 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:31.557384 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 62765.8us
I20260503 07:58:31.558229 27999 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:31.497810 30752 raft_consensus.cc:697] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:31.587518 30751 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:31.548307 30673 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:31.593717 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:31.588723 30695 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.594237 28026 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:31.595512 30695 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:31.532303 30504 consensus_queue.cc:1048] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260503 07:58:31.607606 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:31.608369 27953 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:31.616961 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 89278.5us
I20260503 07:58:31.612850 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:31.617650 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.617166 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:31.618409 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:31.622087 28029 raft_consensus.cc:1240] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 11. Current term is 12. Ops: []
W20260503 07:58:31.624241 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.603896 30751 raft_consensus.cc:697] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:31.628103 30751 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.636785 27953 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:31.654238 28583 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:31.607554 30753 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election won for term 11
I20260503 07:58:31.661298 28029 raft_consensus.cc:1275] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:31.661527 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.664466 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.666195 28033 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:31.664376 30752 consensus_queue.cc:237] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.658224 30496 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
W20260503 07:58:31.663524 30710 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
I20260503 07:58:31.683522 28035 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:31.687855 28026 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
I20260503 07:58:31.685920 30519 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:31.693969 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.694715 28033 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 11: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:31.697515 28029 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
W20260503 07:58:31.698890 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.701222 30749 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:31.703097 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.704618 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.705348 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.708642 28032 raft_consensus.cc:2410] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260503 07:58:31.690708 30673 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.674803 30753 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:31.705927 30496 raft_consensus.cc:697] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:31.707901 28033 raft_consensus.cc:1240] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:31.713907 28035 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:31.723196 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.727358 28026 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:31.711826 27856 catalog_manager.cc:5671] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 6 to 7, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 7 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260503 07:58:31.728535 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.730830 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.748755 28029 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:31.748576 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:31.749768 28027 raft_consensus.cc:2376] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6. Re-sending same reply.
I20260503 07:58:31.757555 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:31.760217 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 144634us
I20260503 07:58:31.733865 30749 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:31.765225 28109 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260503 07:58:31.815907 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.710922 30753 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.822225 27953 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 5. Current term is 6. Ops: []
W20260503 07:58:31.822376 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 52924.2us
I20260503 07:58:31.823765 28105 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260503 07:58:31.826334 27953 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:58:31.766283 30749 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:31.834404 30767 consensus_queue.cc:1059] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260503 07:58:31.835995 30767 raft_consensus.cc:3055] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:31.836293 30767 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:31.836720 30749 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:31.824607 30694 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260503 07:58:31.839268 30667 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 6 to 9, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:31.843163 28031 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 6 to 9, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:31.854939 28035 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:31.855777 30694 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:31.857625 28026 raft_consensus.cc:1275] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260503 07:58:31.860113 30766 log.cc:927] Time spent T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.090s user 0.002s sys 0.000s
I20260503 07:58:31.861196 28035 raft_consensus.cc:1275] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:31.844152 28029 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:31.844666 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:31.826596 30496 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.864585 28027 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 11.
I20260503 07:58:31.865778 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:31.866338 28035 raft_consensus.cc:2376] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10. Re-sending same reply.
I20260503 07:58:31.863478 28030 raft_consensus.cc:1240] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:31.866575 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:31.889596 27953 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260503 07:58:31.897233 30591 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:31.879386 30474 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260503 07:58:31.903962 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:31.904584 28035 raft_consensus.cc:2376] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6. Re-sending same reply.
I20260503 07:58:31.921263 28032 raft_consensus.cc:1275] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260503 07:58:31.925292 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:31.926262 28075 leader_election.cc:336] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.583s (SENT)
W20260503 07:58:31.968375 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:31.911931 30767 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:31.940234 30749 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:31.981936 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:31.983618 30752 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260503 07:58:32.008050 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 81173us
W20260503 07:58:32.024945 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:32.050856 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.052160 27999 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.056411 27954 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260503 07:58:32.051167 30762 log.cc:927] Time spent T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.225s user 0.000s sys 0.001s
W20260503 07:58:32.083619 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.088783 27842 catalog_manager.cc:5184] ChangeConfig:REMOVE_PEER RPC for tablet eec1cba8286a4c81a9f66d33c805d337 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260503 07:58:32.090291 27999 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.092386 30749 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:32.094308 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.094586 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.094964 28033 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:32.095369 28032 raft_consensus.cc:2393] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.082123 30730 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260503 07:58:32.097795 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.107280 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.107908 28034 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 11: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.108018 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.108703 28035 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.057910 30753 raft_consensus.cc:2749] T 4029065128b84be9a45c0bfe2af75b6f P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:32.124779 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.125541 28033 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
W20260503 07:58:32.173060 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 140284us
I20260503 07:58:32.203985 30591 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.222420 30591 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.224591 30591 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:32.215312 30730 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.225391 30730 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.227192 30730 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:32.233852 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.239636 28034 raft_consensus.cc:1240] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260503 07:58:32.241219 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.242005 28032 raft_consensus.cc:2393] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.244550 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:32.244772 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.245132 27958 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:32.245500 28032 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.246654 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.247311 28073 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.249135 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.249720 28032 raft_consensus.cc:2368] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 4. Current term is 5.
W20260503 07:58:32.249676 28075 leader_election.cc:336] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.781s (SENT)
W20260503 07:58:32.249855 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 141597us
W20260503 07:58:32.251070 28075 leader_election.cc:336] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.803s (SENT)
I20260503 07:58:32.251523 28075 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.269209 30787 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260503 07:58:32.282416 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.256597 30730 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:32.290390 28107 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260503 07:58:32.294852 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:32.299722 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 48808.2us
I20260503 07:58:32.291165 30730 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:32.308357 30730 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:32.310726 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.311615 28035 raft_consensus.cc:2368] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 9. Current term is 10.
I20260503 07:58:32.318548 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.319106 28035 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:32.342151 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.342767 28032 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 12: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.344233 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:32.344825 28075 leader_election.cc:336] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.689s (SENT)
I20260503 07:58:32.345193 28075 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.346057 30377 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:32.348052 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.348402 28617 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260503 07:58:32.348647 28035 raft_consensus.cc:2393] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:32.349298 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.349489 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:32.350006 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.350062 28617 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:32.350703 28030 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:32.351485 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.352485 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.353520 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.355300 27958 raft_consensus.cc:1275] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260503 07:58:32.356525 30767 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:32.350010 28034 raft_consensus.cc:2393] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.359138 27958 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:32.349344 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.361202 28033 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.362747 28073 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.364353 30377 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:32.364689 30792 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260503 07:58:32.365311 30787 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260503 07:58:32.365563 30786 log.cc:927] Time spent T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260503 07:58:32.365725 30787 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:32.366139 30787 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:32.359166 30730 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.368422 30504 consensus_queue.cc:1048] T 77488bc798a841d697b108fb23d5531b P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260503 07:58:32.369370 30695 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:32.369880 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.368643 30730 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:32.372205 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.372929 28032 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 11: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.372219 27854 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 3 to 4, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 4 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:32.377617 28026 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:32.380177 28035 raft_consensus.cc:1240] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:32.381215 28107 raft_consensus.cc:2955] T eec1cba8286a4c81a9f66d33c805d337 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 6 to 9, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
W20260503 07:58:32.382172 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.382465 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.383126 28035 raft_consensus.cc:2393] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
W20260503 07:58:32.383489 30791 log.cc:927] Time spent T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.066s user 0.000s sys 0.001s
I20260503 07:58:32.386893 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33434 (request call id 324) took 1451 ms. Trace:
I20260503 07:58:32.394196 28026 raft_consensus.cc:1275] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260503 07:58:32.403240 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:32.403954 27954 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:32.389500 27857 rpcz_store.cc:276] 0503 07:58:30.935794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:30.936030 (+ 236us) service_pool.cc:224] Handling call
0503 07:58:32.386818 (+1450788us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:31.541859 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:31.542383 (+ 524us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:31.542438 (+ 55us) write_op.cc:435] Acquired schema lock
0503 07:58:31.542464 (+ 26us) tablet.cc:662] Decoding operations
0503 07:58:31.543414 (+ 950us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:31.543483 (+ 69us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:31.543520 (+ 37us) tablet.cc:685] Acquiring locks for 6 operations
0503 07:58:31.544108 (+ 588us) tablet.cc:701] Row locks acquired
0503 07:58:31.544133 (+ 25us) write_op.cc:260] PREPARE: finished
0503 07:58:31.544280 (+ 147us) write_op.cc:270] Start()
0503 07:58:31.544406 (+ 126us) write_op.cc:276] Timestamp: P: 1777795111544245 usec, L: 0
0503 07:58:31.544433 (+ 27us) op_driver.cc:348] REPLICATION: starting
0503 07:58:31.561415 (+ 16982us) log.cc:844] Serialized 2442 byte log entry
0503 07:58:31.824998 (+263583us) op_driver.cc:464] REPLICATION: finished
0503 07:58:31.828414 (+ 3416us) write_op.cc:301] APPLY: starting
0503 07:58:31.828479 (+ 65us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:31.828619 (+ 140us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:31.828697 (+ 78us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:31.829385 (+ 688us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:31.829549 (+ 164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0503 07:58:31.829590 (+ 41us) write_op.cc:312] APPLY: finished
0503 07:58:31.829804 (+ 214us) log.cc:844] Serialized 53 byte log entry
0503 07:58:31.829942 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:31.830009 (+ 67us) write_op.cc:454] Released schema lock
0503 07:58:31.830036 (+ 27us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":85910,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":1513,"apply.run_cpu_time_us":1826,"apply.run_wall_time_us":1826,"num_ops":6,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":3565,"prepare.run_wall_time_us":41754,"replication_time_us":221647}]]}
I20260503 07:58:32.451300 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:32.454617 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.455648 27954 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:32.457065 28073 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.464399 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.474532 30787 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.476531 30787 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:32.482739 28075 leader_election.cc:336] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.768s (SENT)
I20260503 07:58:32.483094 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.463649 30591 raft_consensus.cc:2804] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:32.493497 30591 raft_consensus.cc:697] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:32.490991 30672 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:32.495460 28029 raft_consensus.cc:3055] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:32.498030 28029 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:32.500531 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.501180 28026 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.498756 28029 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.503718 28029 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:32.504279 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:32.509666 28613 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:32.494467 30591 consensus_queue.cc:237] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:32.517408 28075 leader_election.cc:336] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.860s (SENT)
I20260503 07:58:32.521840 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.530964 30543 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:32.504710 30752 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:32.534610 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:32.538818 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.540436 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.540937 28027 raft_consensus.cc:1275] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260503 07:58:32.541532 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.541865 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.542495 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.542781 28031 raft_consensus.cc:3055] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:32.543017 28034 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:32.543772 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.544360 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:32.543119 28031 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:32.545233 28031 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.546335 28031 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:32.553747 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.554251 28034 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
W20260503 07:58:32.555433 28075 leader_election.cc:336] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.878s (SENT)
I20260503 07:58:32.556242 28031 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260503 07:58:32.556305 28075 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.558312 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:32.559469 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:32.561226 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:32.562276 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:32.566033 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:32.567061 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:32.561697 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:32.567094 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:32.570001 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.571120 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.572918 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:32.557245 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.573478 28103 raft_consensus.cc:1240] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:32.573868 28031 raft_consensus.cc:2393] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 11: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.573238 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:32.575870 28108 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:32.578100 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.580717 28031 raft_consensus.cc:2393] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.581557 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.554672 30752 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.588685 28027 raft_consensus.cc:2468] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:32.590539 30752 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:32.592053 28075 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.593144 30730 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:32.593639 30639 consensus_queue.cc:1048] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:32.595597 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.596647 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.597299 30713 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:32.598373 30769 consensus_queue.cc:1059] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:32.599025 30377 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:32.599586 30713 raft_consensus.cc:3055] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:32.600003 30713 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:32.600541 28613 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:32.601663 30730 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:32.598563 27926 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.602535 30472 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:32.600839 30713 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.593173 30474 consensus_queue.cc:1059] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260503 07:58:32.604334 30474 raft_consensus.cc:3055] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 11 LEADER]: Stepping down as leader of term 11
I20260503 07:58:32.604642 30474 raft_consensus.cc:740] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:32.604911 27926 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.605597 30472 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:32.605346 30474 consensus_queue.cc:260] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.606805 30472 consensus_queue.cc:1059] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:32.616737 28100 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:32.609692 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:32.610524 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.617833 27926 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.619542 28105 raft_consensus.cc:1240] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:32.612651 28622 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:32.607151 30474 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:32.626005 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:32.626623 28107 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:32.626667 28108 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:32.627091 28029 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260503 07:58:32.629702 28104 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260503 07:58:32.632216 27999 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.633416 30607 raft_consensus.cc:2764] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260503 07:58:32.633924 28618 raft_consensus.cc:1240] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:32.635149 30752 consensus_queue.cc:1059] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260503 07:58:32.637157 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:32.637897 28032 raft_consensus.cc:2393] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:32.605554 30713 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:32.639070 30767 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:32.640007 28030 raft_consensus.cc:1275] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260503 07:58:32.644307 30749 raft_consensus.cc:3055] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:32.644685 30749 raft_consensus.cc:740] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:32.645458 30749 consensus_queue.cc:260] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.646358 30749 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:32.649271 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:32.619007 30777 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:32.651796 30777 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.653692 30777 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:32.607853 30769 raft_consensus.cc:3055] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:32.655623 30769 raft_consensus.cc:740] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:32.655829 28622 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260503 07:58:32.656355 30769 consensus_queue.cc:260] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.657406 30752 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:32.657653 30769 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:32.626111 30472 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260503 07:58:32.660998 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.662564 28073 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.665932 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.667867 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:32.669688 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:32.675745 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.676110 28617 raft_consensus.cc:2368] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:58:32.675937 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:32.676618 28103 raft_consensus.cc:2393] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:32.675776 27958 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:32.677202 28622 raft_consensus.cc:1240] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
W20260503 07:58:32.675704 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 57948.1us
I20260503 07:58:32.675654 27856 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:32.679711 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.681687 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:32.695287 30730 raft_consensus.cc:993] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:32.695757 30730 raft_consensus.cc:1081] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:32.696817 28075 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.697820 28075 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.698731 28075 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.699602 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.689251 30787 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:32.700562 30787 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:32.689486 30557 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:32.700941 30472 consensus_queue.cc:1048] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:32.676668 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:32.705868 28075 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.709682 27856 catalog_manager.cc:5671] T eec1cba8286a4c81a9f66d33c805d337 P 25017111886b42cfa5701a39de59b6ad reported cstate change: config changed from index 6 to 9, VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) evicted. New cstate: current_term: 9 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:32.686892 30777 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:32.718168 27999 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.691757 30752 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:32.728622 28035 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:32.735316 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.700938 30787 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:32.717383 30672 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:32.707139 30543 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:32.691381 30714 consensus_queue.cc:1059] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260503 07:58:32.719929 30777 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:32.720461 30749 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:32.692487 30716 consensus_queue.cc:1048] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260503 07:58:32.736369 30607 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.738538 30591 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:32.758507 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 319) took 1547 ms. Trace:
W20260503 07:58:32.765524 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 75093.2us
I20260503 07:58:32.739889 30730 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:32.738453 30377 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:32.765692 27854 rpcz_store.cc:276] 0503 07:58:31.211304 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:31.211442 (+ 138us) service_pool.cc:224] Handling call
0503 07:58:32.758450 (+1547008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:32.402713 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:32.501644 (+ 98931us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:32.502984 (+ 1340us) write_op.cc:435] Acquired schema lock
0503 07:58:32.502995 (+ 11us) tablet.cc:662] Decoding operations
0503 07:58:32.553895 (+ 50900us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:32.555932 (+ 2037us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:32.562337 (+ 6405us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:58:32.596517 (+ 34180us) tablet.cc:701] Row locks acquired
0503 07:58:32.596531 (+ 14us) write_op.cc:260] PREPARE: finished
0503 07:58:32.596673 (+ 142us) write_op.cc:270] Start()
0503 07:58:32.596785 (+ 112us) write_op.cc:276] Timestamp: P: 1777795112596638 usec, L: 0
0503 07:58:32.596800 (+ 15us) op_driver.cc:348] REPLICATION: starting
0503 07:58:32.597330 (+ 530us) log.cc:844] Serialized 530 byte log entry
0503 07:58:32.607213 (+ 9883us) op_driver.cc:464] REPLICATION: finished
0503 07:58:32.607580 (+ 367us) write_op.cc:301] APPLY: starting
0503 07:58:32.607654 (+ 74us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:32.607763 (+ 109us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:32.645110 (+ 37347us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:32.645328 (+ 218us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:32.645478 (+ 150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:58:32.645527 (+ 49us) write_op.cc:312] APPLY: finished
0503 07:58:32.645700 (+ 173us) log.cc:844] Serialized 23 byte log entry
0503 07:58:32.645873 (+ 173us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:32.645948 (+ 75us) write_op.cc:454] Released schema lock
0503 07:58:32.645983 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:32.646273 (+ 290us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:32.646297 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62649,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":206,"apply.run_cpu_time_us":1566,"apply.run_wall_time_us":38647,"num_ops":1,"prepare.queue_time_us":13235,"prepare.run_cpu_time_us":2946,"prepare.run_wall_time_us":203538,"replication_time_us":10288}]]}
I20260503 07:58:32.772114 30716 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.772599 30716 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.774405 30716 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:32.769547 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.757614 30777 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:32.786242 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 46100.2us
I20260503 07:58:32.792367 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.761270 30749 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:32.761217 30752 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260503 07:58:32.797046 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 61786.3us
I20260503 07:58:32.798278 28075 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.814551 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:32.791865 30377 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:32.816285 27926 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.785324 30809 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:32.764954 30607 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.852139 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.852842 30607 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:32.854300 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.781507 30543 consensus_queue.cc:1059] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260503 07:58:32.829442 30815 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.829623 30753 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:32.829689 30547 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:32.820811 30730 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260503 07:58:32.829929 30817 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260503 07:58:32.835919 30377 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.868848 30814 raft_consensus.cc:3055] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:32.869197 30814 raft_consensus.cc:740] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:32.869936 30814 consensus_queue.cc:260] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.871186 30814 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:32.829715 27926 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.848770 30787 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:32.873553 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 43911.4us
I20260503 07:58:32.874495 30787 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:32.796598 30749 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:32.875258 30817 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260503 07:58:32.875691 30817 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:32.876192 30817 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:32.798478 30752 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:32.859843 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.881209 30752 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:32.881371 28104 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:32.815640 30810 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.884038 30817 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.884632 30810 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.885921 30817 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:32.855396 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 57213.4us
I20260503 07:58:32.811918 30557 raft_consensus.cc:697] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:32.886829 30810 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:32.886920 30557 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.854885 30809 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:32.888026 30809 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:32.864825 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.872641 30777 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.890421 28075 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.874678 27926 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.864727 27855 catalog_manager.cc:5671] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 9, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 9 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:32.892643 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:32.875720 30591 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:32.893978 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.897284 28103 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:32.894477 27924 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.860571 30639 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.891568 27855 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:32.890722 28109 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:32.907339 27855 catalog_manager.cc:5671] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:32.893396 30547 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:32.902464 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:32.910151 27956 raft_consensus.cc:2393] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:32.862149 30813 consensus_queue.cc:1048] T a2ab306b1af74c9ab53cebf8986a9e48 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260503 07:58:32.863641 30815 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.905385 30820 consensus_queue.cc:1048] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260503 07:58:32.927598 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 52970.2us
I20260503 07:58:32.928653 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.926267 30547 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.935708 27956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:32.936241 27956 raft_consensus.cc:606] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:32.936520 27956 raft_consensus.cc:614] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:32.937055 30812 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:32.907135 30787 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:32.939888 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:32.937740 30812 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:32.940438 28622 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:32.946301 27924 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.936903 30547 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:32.955152 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:32.933573 30817 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:32.934547 30591 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:32.938663 30769 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260503 07:58:32.961678 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 107427us
I20260503 07:58:32.962325 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:32.963308 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.963984 30823 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:32.964526 30823 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:32.964877 30823 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:32.926689 30639 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.941267 30713 consensus_queue.cc:1048] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260503 07:58:32.953384 30767 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.970069 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:32.957422 30810 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:32.957327 30812 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:32.960104 30607 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:32.995388 30607 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:32.995715 30607 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:32.995788 30812 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:32.974949 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.976800 30810 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.001467 30810 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.003171 30752 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.003479 30809 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.977885 28109 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:32.979514 30777 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:32.982343 30815 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:32.965939 30547 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:32.985211 30629 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.988891 30639 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:32.990788 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.959910 30769 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:32.967424 30591 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.958648 30749 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:32.992368 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:32.974261 30817 raft_consensus.cc:697] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:32.966549 30816 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:32.993127 30825 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:32.992880 30767 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:32.993374 30716 raft_consensus.cc:3055] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Stepping down as leader of term 8
W20260503 07:58:33.084021 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:32.968382 30753 raft_consensus.cc:697] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:33.091001 28103 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:33.100849 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.010665 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.099591 27857 catalog_manager.cc:5671] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 9 to 10, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 10 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:33.040733 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.110984 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.111984 27954 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:33.049032 30814 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:33.081987 30543 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:33.041649 30672 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:33.091022 30716 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:33.004949 30752 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.098763 30769 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.098223 30547 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:33.106364 30815 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:33.022310 30809 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.135352 27954 raft_consensus.cc:1240] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 11. Current term is 12. Ops: []
I20260503 07:58:33.119076 30825 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260503 07:58:33.104383 30639 consensus_queue.cc:1059] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260503 07:58:33.130023 30474 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:33.153159 30474 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.102013 30629 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.154946 30474 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.155597 30629 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:33.156627 27952 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:33.136327 30815 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.157967 30815 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:33.158886 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:33.141081 30749 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.141798 30817 consensus_queue.cc:237] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.094694 30816 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.052026 30810 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.040608 30823 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.009694 30607 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.161307 28622 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:33.162531 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.170028 27924 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:33.170495 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.171331 27953 raft_consensus.cc:2393] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:33.171968 27952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:33.173458 30377 consensus_queue.cc:1059] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:33.174387 30377 raft_consensus.cc:3055] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260503 07:58:33.174782 30377 raft_consensus.cc:740] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:33.175673 30377 consensus_queue.cc:260] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.164654 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.181277 27954 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 8.
I20260503 07:58:33.153505 30752 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:33.182250 30816 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.182016 30752 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.167529 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:33.183604 28617 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:33.136794 30547 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.146193 30591 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.185746 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:33.187505 28583 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:33.182914 30813 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260503 07:58:33.195024 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 264405us
I20260503 07:58:33.126704 30814 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.196990 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.197237 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.204512 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:33.205294 28103 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
I20260503 07:58:33.129339 30543 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.212854 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.213892 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.138051 30672 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.188499 30474 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:33.220228 28108 raft_consensus.cc:2393] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 5: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
W20260503 07:58:33.219182 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 249180us
I20260503 07:58:33.199821 30787 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:33.221387 27957 raft_consensus.cc:1240] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:33.188515 30812 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:33.231314 30543 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.221887 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.229171 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.229924 30767 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.208463 27954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:33.237670 27954 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:33.237978 27954 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.230455 30810 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.153558 30716 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.242300 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.240739 30825 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:33.252942 27854 catalog_manager.cc:5671] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:33.239326 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.212150 27958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
from {username='slave'} at 127.0.0.1:45176
I20260503 07:58:33.254484 27958 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:33.232059 30787 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:33.210692 30377 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:33.232093 27953 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:33.219619 30795 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:33.247511 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:33.222213 30474 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.234402 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:33.250288 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.261412 28617 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:33.250849 27960 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:33.253520 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.254954 27958 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.262496 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.263182 30672 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:33.259266 30809 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:33.254629 27854 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:33.240911 28104 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:33.239499 27924 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.265849 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.209975 30753 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.255905 27954 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.220382 30769 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.260140 27955 raft_consensus.cc:1240] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:33.258646 30787 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:33.266117 27854 catalog_manager.cc:5671] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:33.273217 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.256564 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.265873 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:33.238483 30812 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.266635 27951 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:33.269240 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.273952 27854 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:33.274644 28108 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.277325 28073 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.272284 27958 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.278111 28073 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.279203 27953 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260503 07:58:33.280354 27955 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:33.280776 27958 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.270035 27954 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.270816 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:33.282469 28108 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:33.261101 30795 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.264892 30474 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.283633 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.284722 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.284983 27924 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.285312 28109 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.283699 27956 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:33.285764 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:33.286329 28622 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:33.265300 30823 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.286269 30591 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:33.269176 30716 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.274165 30472 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:33.291662 27924 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.292106 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:33.293479 27960 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:33.294838 28617 raft_consensus.cc:3055] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:33.295264 28617 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:33.285532 30752 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.293483 30827 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:33.296207 30810 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:33.296109 28617 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.296712 30810 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.297197 30812 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.298205 30810 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.283931 30824 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:33.284714 30496 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:33.299353 28617 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.284440 30809 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:33.286821 30795 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.284823 30814 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.287911 30749 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260503 07:58:33.290017 30639 raft_consensus.cc:2804] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:33.324988 28617 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:33.305361 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.326510 28108 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:33.303643 27999 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.290328 30713 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:33.290134 30825 consensus_queue.cc:1059] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260503 07:58:33.308348 30819 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:33.298617 30820 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:33.304653 30607 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.304631 30810 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:33.305979 30827 consensus_queue.cc:1059] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260503 07:58:33.294606 30472 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.318303 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:33.320418 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.331594 30752 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260503 07:58:33.346674 30820 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.330546 30825 raft_consensus.cc:3055] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:33.346526 30810 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.330256 30809 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:33.350992 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.353605 28035 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:33.351178 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.354679 28028 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:33.351562 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:33.349329 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 44931.9us
I20260503 07:58:33.288076 30591 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.301617 30824 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.303020 30496 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.330087 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.330153 27924 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:33.305225 30815 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.346537 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.347962 28032 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260503 07:58:33.370077 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.350903 30810 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:33.370962 28617 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:58:33.351361 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.371029 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.372102 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.372193 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.324069 28109 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:33.364598 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:33.372633 28104 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.371585 28033 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:33.333281 30769 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.331866 30639 raft_consensus.cc:697] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:33.350613 30825 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:33.358050 30809 raft_consensus.cc:697] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:33.352604 30671 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:33.350098 30472 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:33.374877 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.330416 30713 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.350394 30820 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.332216 30819 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: true } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.358822 28108 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:33.528191 27958 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260503 07:58:33.544834 28034 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:33.407086 27924 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.522898 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:33.494172 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:33.423090 28104 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:33.380044 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.547061 28026 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:33.358353 30591 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:33.549180 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 142161us
I20260503 07:58:33.552681 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.554334 28108 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:33.557340 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.558717 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:33.372048 30496 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.560820 28031 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:33.560771 27924 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.373350 30607 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:33.368642 30824 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:33.588196 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:33.563247 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:33.588858 28034 raft_consensus.cc:3060] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.563925 28026 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:33.558837 30829 raft_consensus.cc:2804] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:33.584043 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.586566 28032 raft_consensus.cc:1240] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:33.580196 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:33.569267 28108 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
I20260503 07:58:33.569824 27924 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:33.587183 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.589908 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:33.592038 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.592490 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.593340 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.593850 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:33.593984 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.475872 30815 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:33.426604 30749 raft_consensus.cc:3055] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:33.594786 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:33.595584 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 167823us
I20260503 07:58:33.595777 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:33.602088 27926 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.603340 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.419998 27943 tablet_service.cc:1558] Processing DeleteTablet for tablet eec1cba8286a4c81a9f66d33c805d337 with delete_type TABLET_DATA_TOMBSTONED (TS 37e72845941344c9b0aaa7235a6f4473 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:45162
W20260503 07:58:33.618479 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 69859.8us
I20260503 07:58:33.603025 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:33.605917 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:33.621454 28026 raft_consensus.cc:3060] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.621601 28106 raft_consensus.cc:2393] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 10: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:33.606590 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:33.607198 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:33.608857 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:33.608995 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.613870 28031 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:33.614037 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:33.616408 28028 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.380337 30672 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.224s
I20260503 07:58:33.600544 30607 raft_consensus.cc:697] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:33.636390 30607 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.637121 30819 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.638417 30639 consensus_queue.cc:237] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.422623 30795 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.471071 30474 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.594403 30826 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:33.471267 30547 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.421440 30787 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.642655 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.558635 30543 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260503 07:58:33.652110 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:33.613688 30749 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
W20260503 07:58:33.670369 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 68394.2us
I20260503 07:58:33.671202 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.673674 28031 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:33.674947 28031 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:33.641590 30714 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:33.702419 28103 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:33.693550 27926 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.710076 28026 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:33.665834 30812 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:33.660976 30819 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:33.688418 30815 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:33.686893 30826 raft_consensus.cc:697] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:33.742367 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 48896us
I20260503 07:58:33.744129 27926 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.735435 30714 raft_consensus.cc:697] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:33.738643 30819 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:33.737479 30817 consensus_queue.cc:1059] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260503 07:58:33.746811 30730 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:33.614517 30825 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:33.752707 30818 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:33.775521 28075 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:33.759891 30671 raft_consensus.cc:697] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:33.756062 30816 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260503 07:58:33.827077 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 80650.2us
I20260503 07:58:33.774397 30819 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
W20260503 07:58:33.833292 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 57835.3us
I20260503 07:58:33.848548 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:33.752892 30713 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:33.837170 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:33.813166 30710 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260503 07:58:33.736352 30809 consensus_queue.cc:237] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:33.854660 30832 log.cc:927] Time spent T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20260503 07:58:33.761356 30827 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260503 07:58:33.760022 30810 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.859750 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.860468 27959 raft_consensus.cc:2393] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 5: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:33.864959 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:33.867699 27955 raft_consensus.cc:2393] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:33.866703 28075 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:33.851598 30543 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:33.756333 30749 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.856210 30639 raft_consensus.cc:3055] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:33.882429 27956 raft_consensus.cc:2368] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:33.831087 30730 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:33.911408 30837 log.cc:927] Time spent T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260503 07:58:33.913851 30852 tablet_replica.cc:333] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: stopping tablet replica
I20260503 07:58:33.881631 30543 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:33.884398 30639 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:33.920077 28034 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:33.889936 30377 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:33.892468 30795 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:33.862426 30830 consensus_queue.cc:1059] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260503 07:58:33.895365 30812 raft_consensus.cc:697] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:33.903398 30547 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.939278 30543 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:33.976441 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 109819us
I20260503 07:58:33.897926 30672 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260503 07:58:33.922042 30474 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:33.984846 28075 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:33.968600 30377 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:33.871819 30714 consensus_queue.cc:237] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:33.862592 30826 consensus_queue.cc:237] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:34.010684 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 346608us
W20260503 07:58:34.002532 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 432735us
I20260503 07:58:34.015362 27999 leader_election.cc:400] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367) with higher term. Message: Invalid argument: T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:58:34.018198 27924 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.017772 27999 leader_election.cc:403] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:34.005483 30377 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:34.025754 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:34.022475 28028 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:34.024720 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.027504 27955 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 9: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:34.005517 30847 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:34.042565 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:34.043232 28622 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:34.041054 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:34.024272 30851 log.cc:927] Time spent T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.140s user 0.001s sys 0.000s
I20260503 07:58:34.052935 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:34.064827 28622 raft_consensus.cc:2393] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:34.057698 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
W20260503 07:58:34.070493 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 59141.1us
I20260503 07:58:34.072999 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.073715 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.020025 30829 raft_consensus.cc:697] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:34.026863 30713 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:34.076225 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:34.076385 28032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33294
I20260503 07:58:34.094426 28032 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:34.094533 28034 raft_consensus.cc:2368] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:34.094738 28032 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:34.077292 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:34.077426 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:34.024981 30672 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:34.074579 28027 raft_consensus.cc:2393] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:34.085671 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:33.967937 30671 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.098078 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.098467 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.025362 30817 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:34.005730 30639 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:34.105300 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 129041us
I20260503 07:58:34.106524 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:34.113457 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 115801us
I20260503 07:58:34.114639 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.116413 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:34.116892 28103 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:34.118966 28026 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:34.113480 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.119953 28027 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:34.036576 30547 consensus_queue.cc:1048] T 40656d9e0b58422a98512c2de8445e60 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260503 07:58:34.123128 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 45901.9us
I20260503 07:58:34.086189 30810 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.128510 28105 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260503 07:58:34.136850 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:34.135876 28029 raft_consensus.cc:3060] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:34.142544 30842 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.143194 30842 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.165825 28034 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260503 07:58:34.103307 30845 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:34.180786 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:34.165321 30839 log.cc:927] Time spent T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.245s user 0.000s sys 0.001s
I20260503 07:58:34.136417 30816 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:34.128759 30769 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.127704 30730 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.126818 30713 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:34.180898 28618 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:34.071779 30812 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.202994 28029 raft_consensus.cc:1275] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:34.116868 30817 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.188004 30816 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:58:34.226069 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 196048us
W20260503 07:58:34.226600 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 182478us
I20260503 07:58:34.235819 28583 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:34.238174 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:34.226330 30816 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:34.202158 30769 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.223337 30547 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:34.249200 30547 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.249686 28105 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:34.250957 30547 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.251955 30749 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:34.252107 30547 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.252561 30547 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:34.255479 30472 consensus_meta.cc:287] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.697s user 0.009s sys 0.000s
I20260503 07:58:34.255925 30472 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.256577 30547 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.242079 30853 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:34.240021 30795 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:34.259821 30830 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:34.182293 30845 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.270203 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:34.273852 28032 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:34.287845 30856 log.cc:927] Time spent T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260503 07:58:34.285194 30853 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.213997 30829 consensus_queue.cc:237] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:34.297832 30716 consensus_meta.cc:287] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 1.005s user 0.010s sys 0.000s
I20260503 07:58:34.299198 30817 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:34.300685 30496 consensus_meta.cc:287] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad: Time spent flushing consensus metadata: real 0.740s user 0.002s sys 0.005s
W20260503 07:58:34.303201 30815 consensus_meta.cc:287] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: Time spent flushing consensus metadata: real 0.555s user 0.008s sys 0.000s
W20260503 07:58:34.303504 30591 consensus_meta.cc:287] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.732s user 0.006s sys 0.000s
I20260503 07:58:34.343843 27952 raft_consensus.cc:606] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.344388 27952 raft_consensus.cc:614] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:34.304440 30852 raft_consensus.cc:2243] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260503 07:58:34.308593 30866 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:34.309947 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.320079 28028 raft_consensus.cc:1240] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 9. Current term is 10. Ops: []
W20260503 07:58:34.322203 30860 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260503 07:58:34.329298 30855 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.329421 30880 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:34.329890 27951 raft_consensus.cc:2368] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11.
I20260503 07:58:34.332314 30769 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.335927 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:34.366600 28102 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:34.324689 30787 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:34.352073 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:34.356072 30824 consensus_meta.cc:287] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.752s user 0.006s sys 0.003s
I20260503 07:58:34.358628 27924 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.360630 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:34.363457 28032 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.364380 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:34.346508 30815 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:34.376843 28101 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:34.366923 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:34.274484 30713 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.382681 27960 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:34.398994 30810 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260503 07:58:34.380052 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 281597us
I20260503 07:58:34.385775 30853 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.392290 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:34.392153 30543 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.393432 30377 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.357456 30816 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.371459 30855 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:34.395344 30820 consensus_meta.cc:287] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.833s user 0.005s sys 0.005s
I20260503 07:58:34.362586 30819 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.397975 30825 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:34.378115 30716 raft_consensus.cc:2706] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Received pre-election callback for term 10 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260503 07:58:34.449680 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:34.347126 30591 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.463148 30853 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:34.463284 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.464721 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.466583 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.467837 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:34.468088 28075 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.566s (SENT) [suppressed 39 similar messages]
I20260503 07:58:34.343169 30496 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.369522 30866 raft_consensus.cc:697] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:34.449589 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 49017.3us
I20260503 07:58:34.371716 30842 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.462232 30472 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.469269 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.478818 27959 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 12.
I20260503 07:58:34.479979 28073 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.482046 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:34.483440 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.484447 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.468621 30749 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:34.485937 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:34.488909 28617 raft_consensus.cc:2368] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6.
I20260503 07:58:34.460875 30847 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:34.379096 30824 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.490331 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.455845 30815 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260503 07:58:34.479130 30852 raft_consensus.cc:2272] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260503 07:58:34.477293 30853 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:34.492556 30830 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:34.496109 30543 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.496330 30850 consensus_queue.cc:1059] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:34.496512 30855 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.456079 30820 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.497295 30377 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.498113 30496 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.488325 30813 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:34.498322 30889 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:34.498597 28100 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 4.
I20260503 07:58:34.503978 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.516062 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.517077 28107 raft_consensus.cc:2368] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:34.524858 27951 raft_consensus.cc:2368] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:34.526050 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.526733 27958 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:34.530414 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:34.531134 28101 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:34.504609 30812 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260503 07:58:34.535732 28073 leader_election.cc:400] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:34.539489 27999 leader_election.cc:400] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:34.540606 28073 leader_election.cc:403] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260503 07:58:34.540757 27999 leader_election.cc:403] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260503 07:58:34.546339 28103 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:34.510092 30880 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:34.498883 30866 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.549536 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.557572 28102 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:34.557827 28103 raft_consensus.cc:1240] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:34.557993 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:34.548796 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 80715.4us
I20260503 07:58:34.558501 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:34.558991 28106 raft_consensus.cc:3055] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:34.559031 28105 raft_consensus.cc:1240] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:34.559355 28106 raft_consensus.cc:740] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:34.559494 28075 leader_election.cc:336] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.593s (SENT)
I20260503 07:58:34.524113 30813 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:34.559994 28075 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.507651 30749 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260503 07:58:34.534452 30591 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:34.541450 30884 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:34.564213 28029 raft_consensus.cc:1275] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:34.565598 28622 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:58:34.549660 30853 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:34.541887 30830 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.567414 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.563043 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:34.568670 28103 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260503 07:58:34.566779 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:34.569706 30861 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:34.566422 30672 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:34.570114 30857 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260503 07:58:34.571072 28035 raft_consensus.cc:1275] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:34.572350 28032 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:34.560462 30730 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:34.573792 28101 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:34.560074 28106 consensus_queue.cc:260] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.577042 28106 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:34.577389 28622 raft_consensus.cc:1240] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260503 07:58:34.565776 30813 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:34.581205 30894 log.cc:927] Time spent T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260503 07:58:34.571602 30862 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:34.577316 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.582151 28027 raft_consensus.cc:2393] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:34.585923 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:34.590605 30886 log.cc:927] Time spent T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260503 07:58:34.590839 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.595611 28106 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:34.595839 28031 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:34.591552 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.594385 27951 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:34.594295 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.587989 27958 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:34.596850 27955 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:34.597239 30861 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:34.598408 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.599068 30861 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:34.599872 30819 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.600070 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.601064 30861 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:34.575510 30830 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.602617 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.602905 27955 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:34.604383 30830 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:34.604411 30861 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:34.605728 27999 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.607573 30857 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260503 07:58:34.608203 30887 log.cc:927] Time spent T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.114s user 0.001s sys 0.000s
I20260503 07:58:34.571871 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:34.613936 27955 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:34.614019 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.615155 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:34.617892 27951 raft_consensus.cc:1275] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260503 07:58:34.618513 28073 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.619314 28073 leader_election.cc:400] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Vote denied by peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367) with higher term. Message: Invalid argument: T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6.
I20260503 07:58:34.619560 28073 leader_election.cc:403] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260503 07:58:34.615307 27926 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.615877 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.620056 27954 raft_consensus.cc:3060] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:34.625360 30850 consensus_queue.cc:1059] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:34.617684 30795 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:34.625968 30889 consensus_queue.cc:1059] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:34.627027 30820 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:34.627216 27999 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.627641 30864 raft_consensus.cc:3055] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:34.628036 30864 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:34.628123 30850 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:34.628885 27952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60658 (request call id 16) took 1464 ms. Trace:
I20260503 07:58:34.629179 30752 raft_consensus.cc:2804] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:34.629221 27952 rpcz_store.cc:276] 0503 07:58:33.164512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:33.164607 (+ 95us) service_pool.cc:224] Handling call
0503 07:58:34.628724 (+1464117us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540007f3d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850471ec33 00007f85096facca 00007f8502c73934 00007f8502c738c2 00007f8502c737f1 00007f8502c7376c 00007f8502c72a22 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:34.628812 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2693785344}
I20260503 07:58:34.629710 30752 raft_consensus.cc:697] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:34.630611 30819 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:34.630518 30752 consensus_queue.cc:237] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.631033 30819 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:34.631439 30819 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:34.636430 30855 consensus_queue.cc:1059] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:34.637470 30855 raft_consensus.cc:3055] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:34.637754 30845 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.635465 28075 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.616649 30809 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367) with higher term. Message: Invalid argument: T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5.
I20260503 07:58:34.616365 30816 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:34.642297 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.644610 28031 raft_consensus.cc:2393] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:34.648468 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.648612 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:34.622880 28613 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:34.649164 27952 raft_consensus.cc:2393] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:34.652170 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:34.652697 28106 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
W20260503 07:58:34.653712 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:34.631910 30591 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:34.652501 28583 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.632170 30847 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:34.655061 27955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28731014d42b4316af0150b0e98f6152"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:34.655844 28617 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:34.658069 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.661584 27924 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.661610 27955 raft_consensus.cc:606] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.655988 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:34.662945 28622 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:34.637769 30855 raft_consensus.cc:740] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:34.664235 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:34.665659 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.669888 28035 raft_consensus.cc:2393] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 12: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:34.655603 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:34.644989 30885 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367) with higher term. Message: Invalid argument: T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6.
I20260503 07:58:34.639272 30795 raft_consensus.cc:697] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:34.670430 28103 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 11.
I20260503 07:58:34.623186 30857 consensus_queue.cc:1059] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260503 07:58:34.671411 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:34.687060 28031 raft_consensus.cc:2393] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:34.667887 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:34.688807 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:34.668722 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:34.690240 28033 raft_consensus.cc:2410] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260503 07:58:34.677515 27924 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.664361 30847 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:34.677261 30824 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.694103 27954 raft_consensus.cc:2468] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:34.628728 30864 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.667343 30838 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:34.666358 30829 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:34.699137 27954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:34.703850 27926 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.704268 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:34.712715 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:34.677068 30591 raft_consensus.cc:697] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:34.713910 27954 raft_consensus.cc:606] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.723802 27954 raft_consensus.cc:614] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:34.715243 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:34.722456 27999 leader_election.cc:400] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11.
I20260503 07:58:34.726390 27999 leader_election.cc:403] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:34.727175 28106 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 11.
I20260503 07:58:34.727186 27924 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.694833 30847 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:34.729977 30859 consensus_queue.cc:1048] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260503 07:58:34.666309 30858 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.693197 30845 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260503 07:58:34.733853 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:34.698508 30769 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:34.697714 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:34.667160 30873 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:34.739863 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.735515 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.711511 30838 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:34.716292 30816 consensus_queue.cc:1048] T a77e35309a36413d8eaa064760e0e7ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260503 07:58:34.666183 30882 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:34.714875 30829 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:34.717099 30815 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260503 07:58:34.747830 27924 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.748301 28622 raft_consensus.cc:2468] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:34.734915 30769 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:34.696642 30557 consensus_queue.cc:1048] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260503 07:58:34.664594 30900 consensus_queue.cc:1059] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260503 07:58:34.732172 30713 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260503 07:58:34.732375 30716 raft_consensus.cc:2749] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:34.741466 30864 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:34.739135 30752 raft_consensus.cc:3060] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 11
I20260503 07:58:34.755718 27954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:34.766938 27954 raft_consensus.cc:606] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.755120 30838 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:34.768941 27952 raft_consensus.cc:1240] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:34.751505 30852 ts_tablet_manager.cc:1916] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260503 07:58:34.770092 28031 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:34.774649 30825 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260503 07:58:34.776297 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:34.760543 30749 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:34.781484 30874 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:34.785544 30830 raft_consensus.cc:3055] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:34.763420 30829 raft_consensus.cc:3060] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:34.762960 30769 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:34.764750 30713 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:34.766404 30714 raft_consensus.cc:2804] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader election won for term 11
I20260503 07:58:34.788727 27924 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:34.733402 30855 consensus_queue.cc:260] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.763444 30857 consensus_queue.cc:1048] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260503 07:58:34.748986 30813 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.743546 30795 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:34.799680 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 59879.5us
I20260503 07:58:34.749928 30591 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.764724 30861 consensus_queue.cc:1059] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260503 07:58:34.794128 30830 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:34.807334 28107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43222 (request call id 1736) took 1215 ms. Trace:
I20260503 07:58:34.758831 30858 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.803323 30900 raft_consensus.cc:2804] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:34.791862 30826 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260503 07:58:34.805335 30714 raft_consensus.cc:697] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:34.797933 30713 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:34.813148 28107 rpcz_store.cc:276] 0503 07:58:33.591795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:33.592229 (+ 434us) service_pool.cc:224] Handling call
0503 07:58:34.807211 (+1214982us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b540037c3d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:34.807296 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053195648}
I20260503 07:58:34.814368 27954 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:34.823599 28100 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260503 07:58:34.829902 28073 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.840273 30639 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:34.827462 30900 raft_consensus.cc:697] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:34.854561 30607 raft_consensus.cc:993] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:34.854980 30607 raft_consensus.cc:1081] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
W20260503 07:58:34.860322 30905 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260503 07:58:34.860597 30870 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260503 07:58:34.831597 30777 consensus_queue.cc:1059] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260503 07:58:34.863991 30777 raft_consensus.cc:3055] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:34.864281 30777 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:34.864931 30900 consensus_queue.cc:237] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.847388 30874 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260503 07:58:34.866060 30874 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:34.866385 30874 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:34.864989 30777 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.883708 28100 raft_consensus.cc:1275] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:34.885732 30818 consensus_queue.cc:1048] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:34.885906 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:34.857753 30730 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:34.839519 30830 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:34.901613 30830 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:34.904860 27953 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:34.919291 28103 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:34.916196 30557 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.925221 30557 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.868295 30714 consensus_queue.cc:237] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.914580 30730 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:34.947458 30730 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:34.952224 30730 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.953222 30853 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:34.956166 28105 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:34.957800 27960 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:34.958997 28073 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.932729 30813 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:34.960114 28073 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.961030 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:34.965767 27960 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 12.
I20260503 07:58:34.966252 30901 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:34.967949 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:34.968634 30873 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260503 07:58:34.969108 30873 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:34.969498 30873 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:34.976119 28107 raft_consensus.cc:1275] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:34.972707 30882 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:34.973351 30845 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:34.988221 28034 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:34.982599 30639 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260503 07:58:34.996997 30882 raft_consensus.cc:697] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:35.004951 30882 consensus_queue.cc:237] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.008152 28613 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:34.985482 30858 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:34.991731 30847 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.023795 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:35.024397 27953 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:35.025105 30847 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:35.025223 30752 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11.
I20260503 07:58:35.025808 28102 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11. Ops: []
I20260503 07:58:35.026051 28073 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:34.996439 30769 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.032025 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:35.036720 28107 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:35.029520 30557 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:35.046274 30819 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.053159 27951 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:35.055624 30819 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.055732 30769 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.041234 30874 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.058012 30838 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:35.059679 30838 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.063913 30874 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:35.044983 30713 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.067735 30713 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 13 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:35.064581 30914 log.cc:927] Time spent T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
I20260503 07:58:35.072273 30862 raft_consensus.cc:3055] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:35.072741 30862 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:35.064246 30829 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.087216 30817 raft_consensus.cc:3055] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:35.087692 30817 raft_consensus.cc:740] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.088726 30817 consensus_queue.cc:260] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.091102 30817 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:35.075420 30916 log.cc:927] Time spent T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260503 07:58:35.092717 30852 ts_tablet_manager.cc:1929] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260503 07:58:35.099920 30855 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
W20260503 07:58:35.095404 30910 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.118s user 0.001s sys 0.000s
I20260503 07:58:35.093532 30845 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:35.101768 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 334660us
I20260503 07:58:35.104483 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.102409 30861 consensus_queue.cc:1243] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260503 07:58:35.105876 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.106340 28027 raft_consensus.cc:3060] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:35.108637 30864 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.109094 30864 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.102917 30884 consensus_queue.cc:1059] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260503 07:58:35.110562 30884 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.110687 30864 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.111241 30864 raft_consensus.cc:3055] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:35.111552 30864 raft_consensus.cc:740] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:35.113265 30777 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:35.114408 28027 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:35.114506 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.115032 28028 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 12.
I20260503 07:58:35.110999 30884 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.101452 30852 log.cc:1199] T eec1cba8286a4c81a9f66d33c805d337 P 37e72845941344c9b0aaa7235a6f4473: Deleting WAL directory at /tmp/dist-test-taskkJ9Ylu/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1777794976273375-26792-0/minicluster-data/ts-0-root/wals/eec1cba8286a4c81a9f66d33c805d337
I20260503 07:58:35.120146 30857 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:35.120621 30857 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.123221 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
W20260503 07:58:35.126086 27905 auto_rebalancer.cc:285] failed to send replica move request: Illegal state: Replica 37e72845941344c9b0aaa7235a6f4473 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:35.127557 30857 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.115494 30845 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.121943 30880 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:35.137822 28034 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260503 07:58:35.139146 30864 consensus_queue.cc:260] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:35.118660 30873 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.160020 27855 catalog_manager.cc:5671] T b81225f6fe134f46a66b68b7b1656ec5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:35.140313 30880 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.160118 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:35.157377 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28731014d42b4316af0150b0e98f6152"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:35.163036 28031 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:35.163326 28031 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
W20260503 07:58:35.166666 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 140737us
I20260503 07:58:35.168021 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:35.170086 28102 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:35.150092 30864 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:35.169602 30557 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.181778 28031 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:35.186518 28030 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 11.
I20260503 07:58:35.178542 30880 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.175786 30884 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.184026 30900 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.205529 28105 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:35.171260 30591 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
W20260503 07:58:35.212500 27905 auto_rebalancer.cc:806] Removing replace marker failed: Replica 37e72845941344c9b0aaa7235a6f4473 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:35.212798 30591 raft_consensus.cc:697] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:35.212954 27905 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet efcad53159b446a285a0bdf1f53a426e, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:35.213331 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet efcad53159b446a285a0bdf1f53a426e, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.159396 30862 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:35.223594 30926 log.cc:927] Time spent T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260503 07:58:35.226802 30873 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:35.226317 30591 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:35.203032 30829 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:35.232703 30923 log.cc:927] Time spent T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.132s user 0.001s sys 0.000s
I20260503 07:58:35.233661 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:35.235424 27924 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.196477 28102 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:35.205662 30900 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.214952 28031 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:35.204988 30557 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.235976 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.238114 28028 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
W20260503 07:58:35.240239 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:35.240478 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:35.241226 27955 raft_consensus.cc:2368] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 12. Current term is 13.
I20260503 07:58:35.240866 27924 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.243734 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:35.244274 28101 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:35.248571 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:35.248976 27955 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:35.249248 28106 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:35.254130 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:35.237663 30862 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:35.255506 28101 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 13.
W20260503 07:58:35.256134 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:35.255523 28073 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.260519 28106 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:35.257346 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:35.265743 28073 leader_election.cc:400] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 12. Current term is 13.
I20260503 07:58:35.266014 28073 leader_election.cc:403] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260503 07:58:35.263018 30873 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:35.270197 30873 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:35.270577 30873 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:35.245589 30829 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:35.273183 30829 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:35.273492 30829 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:35.272831 30472 raft_consensus.cc:993] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:35.274435 30885 consensus_queue.cc:1059] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260503 07:58:35.277405 30900 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.309767 28032 raft_consensus.cc:1275] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260503 07:58:35.317441 28032 pending_rounds.cc:85] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 3
I20260503 07:58:35.317711 28032 pending_rounds.cc:107] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260503 07:58:35.317973 28032 raft_consensus.cc:2889] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:35.319278 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.319896 28032 raft_consensus.cc:2376] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8. Re-sending same reply.
I20260503 07:58:35.310846 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.321043 28026 raft_consensus.cc:3060] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:35.311205 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.325297 28030 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:35.329504 28026 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 13.
I20260503 07:58:35.330605 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.331317 28029 raft_consensus.cc:1275] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260503 07:58:35.332643 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.333640 28026 raft_consensus.cc:2393] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:35.250877 30826 raft_consensus.cc:2804] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:35.371392 28031 raft_consensus.cc:1240] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
W20260503 07:58:35.346129 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:35.373054 28035 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:35.373776 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:35.375097 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.375998 28029 raft_consensus.cc:2393] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:35.376824 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:35.377928 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.378803 28032 raft_consensus.cc:2393] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:35.379442 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.416309 30852 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45162 (request call id 494) took 2096 ms. Trace:
I20260503 07:58:35.276288 30876 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 12. Current term is 13.
W20260503 07:58:35.407567 30928 log.cc:927] Time spent T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.158s user 0.000s sys 0.000s
I20260503 07:58:35.415171 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.436264 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.436652 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.346529 28103 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:35.437242 28033 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:35.340974 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:35.425958 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:35.437908 28109 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:35.438885 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:35.439409 27952 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:35.440878 30819 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.441037 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 320) took 2647 ms. Trace:
I20260503 07:58:35.441203 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.441375 30819 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.441778 28035 raft_consensus.cc:3060] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Advancing to term 13
I20260503 07:58:35.443207 30819 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.443651 27926 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:35.441426 27854 rpcz_store.cc:276] 0503 07:58:32.793546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:32.793682 (+ 136us) service_pool.cc:224] Handling call
0503 07:58:35.440950 (+2647268us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:33.305173 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:33.334452 (+ 29279us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:33.334484 (+ 32us) write_op.cc:435] Acquired schema lock
0503 07:58:33.334501 (+ 17us) tablet.cc:662] Decoding operations
0503 07:58:33.335078 (+ 577us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:33.335126 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:33.335151 (+ 25us) tablet.cc:685] Acquiring locks for 4 operations
0503 07:58:33.335492 (+ 341us) tablet.cc:701] Row locks acquired
0503 07:58:33.335506 (+ 14us) write_op.cc:260] PREPARE: finished
0503 07:58:33.335632 (+ 126us) write_op.cc:270] Start()
0503 07:58:33.335729 (+ 97us) write_op.cc:276] Timestamp: P: 1777795113335593 usec, L: 0
0503 07:58:33.335750 (+ 21us) op_driver.cc:348] REPLICATION: starting
0503 07:58:33.407746 (+ 71996us) log.cc:844] Serialized 1673 byte log entry
0503 07:58:33.479682 (+ 71936us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b18001adac0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f850816688d 00007f8508168b8a 00007f8508168b18 00007f8508168a98 00007f8508168a53 00007f8508167c6c 00007f850a57cd16 00007f850a5774c8 00007f85047306f0
0503 07:58:33.479761 (+ 79us) op_driver.cc:464] REPLICATION: finished
0503 07:58:33.480108 (+ 347us) write_op.cc:301] APPLY: starting
0503 07:58:33.480202 (+ 94us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:33.480378 (+ 176us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:33.480408 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:33.614927 (+134519us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:33.670390 (+ 55463us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0503 07:58:33.687190 (+ 16800us) write_op.cc:312] APPLY: finished
0503 07:58:33.740534 (+ 53344us) log.cc:844] Serialized 41 byte log entry
0503 07:58:33.753976 (+ 13442us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:33.760161 (+ 6185us) write_op.cc:454] Released schema lock
0503 07:58:33.763655 (+ 3494us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:33.847758 (+ 84103us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:33.851480 (+ 3722us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36925,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":2917,"apply.run_wall_time_us":330733,"num_ops":4,"prepare.queue_time_us":7875,"prepare.run_cpu_time_us":3119,"prepare.run_wall_time_us":146707,"replication_time_us":139199,"spinlock_wait_cycles":4509440}]]}
I20260503 07:58:35.444306 30900 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:35.162542 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:35.444743 30900 raft_consensus.cc:697] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.445188 30607 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:35.445678 30900 consensus_queue.cc:237] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.445760 27856 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 4 to 5, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:35.449597 30829 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.450677 27924 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.451277 30829 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.451464 27924 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.451910 30855 raft_consensus.cc:2804] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Leader election won for term 13
I20260503 07:58:35.452181 30829 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:35.452353 30855 raft_consensus.cc:697] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [term 13 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.431690 30852 rpcz_store.cc:276] 0503 07:58:33.373039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:33.419765 (+ 46726us) service_pool.cc:224] Handling call
0503 07:58:33.892139 (+472374us) ts_tablet_manager.cc:1151] Deleting tablet eec1cba8286a4c81a9f66d33c805d337
0503 07:58:33.913386 (+ 21247us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0503 07:58:34.666195 (+752809us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b540038dbd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850472c8ad 00007f85081227bc 00007f8509748cca 00007f8509779990 00007f850975fefd 00007f850975fea9 00007f850975fe39 00007f850975fe01 00007f850975f02d 0000000000379254
0503 07:58:35.069476 (+403281us) tablet_metadata.cc:665] Metadata flushed
0503 07:58:35.092572 (+ 23096us) tablet_metadata.cc:665] Metadata flushed
0503 07:58:35.416208 (+323636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369277,"spinlock_wait_cycles":173437184,"tablet-delete.queue_time_us":217254,"thread_start_us":93252,"threads_started":1}
I20260503 07:58:35.454370 28027 raft_consensus.cc:1275] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260503 07:58:35.454705 28027 pending_rounds.cc:85] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 5
I20260503 07:58:35.454913 28027 pending_rounds.cc:107] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260503 07:58:35.455127 28027 raft_consensus.cc:2889] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:35.456030 28583 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:35.457281 30777 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:35.459961 30777 raft_consensus.cc:697] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:35.460484 28035 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 13.
I20260503 07:58:35.460706 30777 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:35.379906 30817 raft_consensus.cc:1081] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Signalling peer be26cebb7c90445ea9a74f66463457c1 to start an election
I20260503 07:58:35.464015 30855 consensus_queue.cc:237] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.277720 30885 raft_consensus.cc:3055] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:35.469386 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:35.469648 30885 raft_consensus.cc:740] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:35.380625 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.427416 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:35.471381 28032 raft_consensus.cc:2376] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 13. Re-sending same reply.
I20260503 07:58:35.472648 27952 raft_consensus.cc:2468] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 13.
I20260503 07:58:35.473160 28032 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260503 07:58:35.473625 28032 pending_rounds.cc:85] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 5
I20260503 07:58:35.473894 28032 pending_rounds.cc:107] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260503 07:58:35.474184 28032 raft_consensus.cc:2889] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:35.381135 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.426266 30826 raft_consensus.cc:697] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.336392 28102 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:35.475082 28029 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:35.475739 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:35.427416 28075 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:35.477336 28104 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260503 07:58:35.433688 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:35.430876 30880 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:35.495631 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:35.496282 27960 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 10: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:35.434679 28618 raft_consensus.cc:1240] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260503 07:58:35.434784 28617 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:35.436852 28031 raft_consensus.cc:2368] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 12. Current term is 13.
W20260503 07:58:35.500774 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 73429.1us
I20260503 07:58:35.304337 30864 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:35.428215 28028 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:35.342705 28101 raft_consensus.cc:1240] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260503 07:58:35.477418 28102 raft_consensus.cc:2410] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260503 07:58:35.427965 28030 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 9.
I20260503 07:58:35.512574 28029 raft_consensus.cc:1240] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260503 07:58:35.472728 28108 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:35.474953 27855 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 5, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 5 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:35.395314 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.306561 30557 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:35.493429 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:35.520409 27958 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 10: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:35.493613 27959 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260503 07:58:35.494050 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:35.470414 30885 consensus_queue.cc:260] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.494391 28613 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:35.514103 27855 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 7 to 8, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 8 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:35.503201 27842 catalog_manager.cc:5002] TS 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525): tablet eec1cba8286a4c81a9f66d33c805d337 (table test-workload [id=8876eb8454104f9bbcd0776382ffab10]) successfully deleted
I20260503 07:58:35.494524 30826 consensus_queue.cc:237] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.495054 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:35.497076 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:35.494644 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:35.529251 27955 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:35.499259 27952 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:35.531620 27958 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:35.402168 27999 leader_election.cc:400] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 7. Current term is 8.
I20260503 07:58:35.502341 28622 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260503 07:58:35.521102 28617 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260503 07:58:35.533213 28617 pending_rounds.cc:85] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Aborting all ops after (but not including) 6
I20260503 07:58:35.533432 28617 pending_rounds.cc:107] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260503 07:58:35.533741 28617 raft_consensus.cc:2889] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:35.521296 28104 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:35.521039 27924 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:35.532402 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 131478us
I20260503 07:58:35.536239 27958 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:35.281926 30882 consensus_queue.cc:1059] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.242s
I20260503 07:58:35.528180 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:35.538168 27951 raft_consensus.cc:3055] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:35.501484 28075 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:35.534543 28107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6"
dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:43228
I20260503 07:58:35.538838 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.539192 28107 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:35.539600 28107 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:35.538475 27951 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.499933 30829 raft_consensus.cc:697] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:35.544580 27925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:35.550117 30557 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:35.552215 28028 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:35.553176 30847 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260503 07:58:35.553987 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 52577.9us
I20260503 07:58:35.543630 27951 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:35.546139 27924 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.555159 27951 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:35.560909 30817 raft_consensus.cc:2804] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:35.563802 30901 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:35.565996 28104 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
I20260503 07:58:35.528751 30845 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:35.380887 30730 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:35.500089 30819 consensus_queue.cc:1048] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260503 07:58:35.579813 30817 raft_consensus.cc:697] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.577306 27951 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:35.576253 28073 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:35.579172 27905 auto_rebalancer.cc:806] Removing replace marker failed: Replica 37e72845941344c9b0aaa7235a6f4473 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:35.579466 30845 raft_consensus.cc:697] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:35.579774 30882 consensus_queue.cc:1243] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer 37e72845941344c9b0aaa7235a6f4473 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260503 07:58:35.590981 27905 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet 0ecd0742bf5f466c8b6faa8b8c6708af, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.556545 30862 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260503 07:58:35.592643 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet 0ecd0742bf5f466c8b6faa8b8c6708af, TS be26cebb7c90445ea9a74f66463457c1 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.524158 30864 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.557950 30885 raft_consensus.cc:3060] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:35.591156 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:35.588656 28107 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.610515 28107 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:35.537616 30842 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260503 07:58:35.614003 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:35.615371 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:35.554328 30884 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260503 07:58:35.617100 27999 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:35.630841 30845 consensus_queue.cc:237] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.597437 30814 raft_consensus.cc:2804] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260503 07:58:35.572377 30812 consensus_queue.cc:1059] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260503 07:58:35.597927 30862 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:58:35.650144 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 110796us
I20260503 07:58:35.650494 27924 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.651628 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:35.652180 27951 raft_consensus.cc:3055] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:35.652477 27951 raft_consensus.cc:740] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.589321 30730 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.653223 27951 consensus_queue.cc:260] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.596742 30825 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260503 07:58:35.627542 30853 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:35.662520 27951 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:35.633709 30752 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:35.611348 30547 consensus_queue.cc:1059] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260503 07:58:35.628125 30830 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260503 07:58:35.680131 27923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:35.739795 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:35.642079 30862 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:35.662531 30472 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:35.660959 30557 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
I20260503 07:58:35.652889 30629 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
W20260503 07:58:35.817157 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 152432us
I20260503 07:58:35.662642 30814 raft_consensus.cc:697] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [term 13 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:35.671883 30752 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:35.746685 30713 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:35.827319 30472 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:35.830127 27951 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:35.645732 30829 consensus_queue.cc:237] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.677156 30870 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
W20260503 07:58:35.820672 30930 log.cc:927] Time spent T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.068s user 0.003s sys 0.001s
W20260503 07:58:35.821367 30873 consensus_meta.cc:287] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.550s user 0.010s sys 0.003s
I20260503 07:58:35.837425 28073 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:35.838603 27952 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:35.817821 30753 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:35.653084 30817 consensus_queue.cc:237] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.831367 30752 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:35.836997 30884 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.853848 30377 raft_consensus.cc:2804] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:35.661192 30924 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.212s
W20260503 07:58:35.887681 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 270659us
I20260503 07:58:35.860980 30753 raft_consensus.cc:697] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:35.908149 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:35.915115 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:35.916744 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:35.924705 30937 log.cc:927] Time spent T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.177s user 0.000s sys 0.000s
I20260503 07:58:35.898850 30377 raft_consensus.cc:697] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [term 10 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:35.925825 30377 consensus_queue.cc:237] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.854506 30873 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.939651 30949 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.945878 30949 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.866672 30884 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.893177 30557 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260503 07:58:35.940321 30941 log.cc:927] Time spent T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260503 07:58:35.862003 30814 consensus_queue.cc:237] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.961932 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.962612 28028 raft_consensus.cc:3060] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:35.962769 28029 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260503 07:58:35.964988 28029 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260503 07:58:35.965400 28029 pending_rounds.cc:85] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 5
I20260503 07:58:35.965677 28029 pending_rounds.cc:107] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260503 07:58:35.965936 28029 raft_consensus.cc:2889] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:35.967482 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.941443 30864 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:35.948578 30825 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:35.998172 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:35.999397 28075 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:36.000946 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:35.947983 30949 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.007165 28034 raft_consensus.cc:1275] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260503 07:58:36.009470 28032 raft_consensus.cc:3055] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:36.010641 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:36.011166 28032 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:35.898746 30472 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:35.956713 30730 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:35.940671 30819 consensus_queue.cc:1048] T 5b75e8de5b4f4852a6c586b0a4bf99ba P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260503 07:58:36.023165 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:35.997377 30916 log.cc:927] Time spent T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260503 07:58:36.011938 28032 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.045938 28032 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
W20260503 07:58:35.997545 30938 log.cc:927] Time spent T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.160s user 0.000s sys 0.001s
I20260503 07:58:36.024221 28103 raft_consensus.cc:1275] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260503 07:58:36.026516 28028 raft_consensus.cc:2468] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:36.049180 28029 raft_consensus.cc:1240] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260503 07:58:36.050325 30864 consensus_queue.cc:1048] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:36.052543 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.010000 30951 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:36.018909 30910 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260503 07:58:36.049937 30730 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260503 07:58:36.089450 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:36.015198 30825 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:36.114759 30942 log.cc:927] Time spent T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.107s user 0.000s sys 0.000s
W20260503 07:58:36.137727 30947 log.cc:927] Time spent T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
I20260503 07:58:36.091665 30847 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260503 07:58:36.145650 30884 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:36.151762 30885 consensus_meta.cc:287] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 0.534s user 0.005s sys 0.002s
I20260503 07:58:36.163671 30884 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:36.165592 30910 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260503 07:58:36.166271 30873 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:36.168116 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.073623 30951 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.021410 30753 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.174273 30825 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.175045 28030 raft_consensus.cc:2410] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260503 07:58:36.175846 30749 raft_consensus.cc:3055] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Stepping down as leader of term 10
I20260503 07:58:36.182190 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.058272 30591 raft_consensus.cc:2764] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260503 07:58:36.206977 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 192786us
W20260503 07:58:36.194572 28613 consensus_meta.cc:287] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad: Time spent flushing consensus metadata: real 0.651s user 0.007s sys 0.003s
I20260503 07:58:36.232621 30885 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.221473 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:36.252810 28107 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11. Ops: []
I20260503 07:58:36.256474 27955 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:36.264684 28032 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260503 07:58:36.265121 28032 pending_rounds.cc:85] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 5
I20260503 07:58:36.265365 28032 pending_rounds.cc:107] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260503 07:58:36.276448 27999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:36.288638 28032 raft_consensus.cc:2889] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:36.295837 27955 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:36.285526 28075 leader_election.cc:400] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 election: Vote denied by peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375) with higher term. Message: Invalid argument: T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 12. Current term is 13.
I20260503 07:58:36.288360 28619 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 4. Current term is 5. Ops: []
W20260503 07:58:36.403062 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 130634us
I20260503 07:58:36.213613 28617 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260503 07:58:36.259570 30777 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.320021 28100 raft_consensus.cc:1275] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260503 07:58:36.260061 30749 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:36.258249 28613 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:36.285919 30825 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.210269 30884 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.270016 30864 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.067s
I20260503 07:58:36.268513 30885 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.287979 30862 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.328061 30948 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.380489 30951 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:36.382436 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.361790 30543 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:36.374343 30818 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.383358 28105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43222 (request call id 1753) took 1044 ms. Trace:
I20260503 07:58:36.515311 28103 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260503 07:58:36.385461 30949 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.340967 30671 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260503 07:58:36.450644 30472 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:36.522703 28026 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 10: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:36.445533 28075 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:36.453382 28613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51178 (request call id 279) took 1017 ms. Trace:
I20260503 07:58:36.449115 30714 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:36.523579 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 78153.4us
I20260503 07:58:36.507601 30962 consensus_queue.cc:1048] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260503 07:58:36.515260 28105 rpcz_store.cc:276] 0503 07:58:35.338488 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:35.338642 (+ 154us) service_pool.cc:224] Handling call
0503 07:58:35.426761 (+ 88119us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:35.810482 (+383721us) raft_consensus.cc:1534] Early marking committed up to index 7
0503 07:58:35.826877 (+ 16395us) log.cc:844] Serialized 14 byte log entry
0503 07:58:36.017866 (+190989us) log.cc:844] Serialized 14 byte log entry
0503 07:58:36.181666 (+163800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:36.181709 (+ 43us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:36.181752 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:36.383152 (+201400us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54002c79d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:36.383198 (+ 46us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:36.383308 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44915,"prepare.queue_time_us":14103,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":7856,"raft.queue_time_us":162665,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":62699,"spinlock_wait_cycles":788647296,"thread_start_us":353009,"threads_started":2,"wal-append.queue_time_us":342357}
I20260503 07:58:36.444599 30777 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.452844 30825 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.540467 28073 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:36.535378 27926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s user 0.131s sys 0.194s
W20260503 07:58:36.549212 27926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s user 0.131s sys 0.194s
I20260503 07:58:36.549136 27955 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260503 07:58:36.550002 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 614592us
I20260503 07:58:36.518384 30818 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.550855 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:36.552563 28028 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:36.537091 30814 raft_consensus.cc:2749] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:36.521615 30543 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.515192 30948 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.525032 30949 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.559288 30825 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:36.560074 30958 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.186s user 0.001s sys 0.000s
I20260503 07:58:36.557870 30885 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:36.526676 28613 rpcz_store.cc:276] 0503 07:58:35.432707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:35.433481 (+ 774us) service_pool.cc:224] Handling call
0503 07:58:36.449876 (+1016395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:36.578166 28028 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:36.531811 30472 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.547703 30957 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:36.587473 27926 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:36.588742 30961 log.cc:927] Time spent T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.145s user 0.000s sys 0.001s
I20260503 07:58:36.589428 30949 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:36.589504 30861 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260503 07:58:36.535655 30714 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.589437 30474 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260503 07:58:36.595860 30855 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:36.596364 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2149) took 1287 ms. Trace:
W20260503 07:58:36.597504 30963 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260503 07:58:36.599861 28104 raft_consensus.cc:3055] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
W20260503 07:58:36.602864 30959 log.cc:927] Time spent T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260503 07:58:36.651968 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:36.603741 30967 consensus_queue.cc:1048] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260503 07:58:36.573190 30966 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election won for term 7
W20260503 07:58:36.607036 30970 log.cc:927] Time spent T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260503 07:58:36.608145 30777 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:36.609654 30543 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:36.610682 30752 consensus_meta.cc:287] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.747s user 0.010s sys 0.000s
I20260503 07:58:36.612073 30948 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.544557 30965 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260503 07:58:36.614784 28030 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.633268 30884 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.634398 30862 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.635131 30749 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.638756 30960 raft_consensus.cc:2804] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election won for term 9
W20260503 07:58:36.639501 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 52120.3us
W20260503 07:58:36.647375 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 318569us
I20260503 07:58:36.649855 28104 raft_consensus.cc:740] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:36.646580 28035 rpcz_store.cc:276] 0503 07:58:35.321810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:35.461101 (+139291us) service_pool.cc:224] Handling call
0503 07:58:35.461397 (+ 296us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:35.462469 (+ 1072us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:35.462496 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:35.512682 (+ 50186us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b2c00006d78. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850301ec81 00007f850302e5e2 00007f850475fde1 00007f850472481a 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22
0503 07:58:35.513945 (+ 1263us) log.cc:844] Serialized 26 byte log entry
0503 07:58:35.647024 (+133079us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:35.664219 (+ 17195us) log.cc:844] Serialized 14 byte log entry
0503 07:58:35.865748 (+201529us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:35.865824 (+ 76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:36.593098 (+727274us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18000e85a0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501686a33 00007f8501688e01 00007f8501688db9 00007f8501688d49 00007f8501688d11 00007f850168800d 0000000000379254 0000000000379099 00007f8501669fba
0503 07:58:36.596180 (+ 3082us) raft_consensus.cc:1685] finished
0503 07:58:36.596201 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:36.596312 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10459,"prepare.queue_time_us":24739,"prepare.run_cpu_time_us":3223,"prepare.run_wall_time_us":45198,"raft.queue_time_us":89720,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":44508,"spinlock_wait_cycles":44008448,"thread_start_us":292844,"threads_started":2,"wal-append.queue_time_us":293590}
I20260503 07:58:36.644258 30957 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.645546 30812 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:36.707849 30861 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.712282 30949 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.740072 28104 consensus_queue.cc:260] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.749544 28104 raft_consensus.cc:3060] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:36.747306 27926 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:36.756649 28104 raft_consensus.cc:1275] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260503 07:58:36.757143 28031 raft_consensus.cc:1275] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:36.730707 30966 raft_consensus.cc:697] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:36.761473 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.654047 30855 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:36.729342 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:36.769487 28109 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11. Ops: []
I20260503 07:58:36.790041 27958 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:36.791332 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.770486 28104 pending_rounds.cc:85] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Aborting all ops after (but not including) 7
I20260503 07:58:36.792212 28104 pending_rounds.cc:107] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260503 07:58:36.792608 28104 raft_consensus.cc:2889] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:36.779187 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:36.793466 28104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1714) took 1138 ms. Trace:
I20260503 07:58:36.787675 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.787707 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:36.773453 28031 raft_consensus.cc:1275] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260503 07:58:36.794489 28035 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:36.795213 28031 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:36.795614 28035 raft_consensus.cc:1275] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:36.796644 28035 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:36.793987 28104 rpcz_store.cc:276] 0503 07:58:35.655478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:35.655592 (+ 114us) service_pool.cc:224] Handling call
0503 07:58:35.655911 (+ 319us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:36.599772 (+943861us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400311b20. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850469c1a0 00007f85047265a0 00007f8504727611 00007f850472416f 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c
0503 07:58:36.793290 (+193518us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:36.793425 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371713792}
I20260503 07:58:36.749624 30749 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:36.747781 28618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51168 (request call id 334) took 1086 ms. Trace:
I20260503 07:58:36.744648 30948 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:36.798767 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 217464us
I20260503 07:58:36.799074 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.743871 30543 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:36.746779 30962 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:36.803756 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.804592 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:36.815827 28028 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:36.808883 28104 raft_consensus.cc:2410] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260503 07:58:36.735514 30752 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.813750 30753 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:36.814397 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:36.792739 30769 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:36.787941 30884 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:36.767541 30960 raft_consensus.cc:697] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
W20260503 07:58:36.809134 30824 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260503 07:58:36.765054 30858 consensus_queue.cc:1048] T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260503 07:58:36.835486 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:36.851498 28105 raft_consensus.cc:2393] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 10: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:36.764281 30861 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.800419 30629 consensus_queue.cc:1048] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260503 07:58:36.838362 30472 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.815836 30948 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.838889 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:36.757583 30812 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.850199 28032 raft_consensus.cc:1240] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:36.765333 30949 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:36.868125 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:36.801647 30847 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260503 07:58:36.824304 30818 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.836055 30978 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260503 07:58:36.893673 30976 log.cc:927] Time spent T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260503 07:58:36.849501 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:36.896644 30714 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.839243 30884 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.807166 28618 rpcz_store.cc:276] 0503 07:58:35.653123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:35.660347 (+ 7224us) service_pool.cc:224] Handling call
0503 07:58:35.825613 (+165266us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:35.894644 (+ 69031us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:35.898135 (+ 3491us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:35.953729 (+ 55594us) log.cc:844] Serialized 26 byte log entry
0503 07:58:36.286242 (+332513us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:36.286304 (+ 62us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:36.286396 (+ 92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:36.728638 (+442242us) raft_consensus.cc:1685] finished
0503 07:58:36.730082 (+ 1444us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:36.737336 (+ 7254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13791,"raft.queue_time_us":15568,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":29713,"thread_start_us":279102,"threads_started":1,"wal-append.queue_time_us":416961}
I20260503 07:58:36.900359 30884 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.901438 30855 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:36.836002 30753 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.889504 30966 consensus_queue.cc:237] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.903446 30753 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:36.903406 30752 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:36.895712 28028 raft_consensus.cc:2410] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260503 07:58:36.835162 30952 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260503 07:58:36.919348 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:36.913285 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.920403 28104 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:36.921433 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.923539 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.924106 27960 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 9.
I20260503 07:58:36.831383 30543 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:36.822552 30962 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:36.914817 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.932323 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.915050 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.915927 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.933914 27955 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:36.916582 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.926878 27953 raft_consensus.cc:1240] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260503 07:58:36.927829 27957 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260503 07:58:36.914191 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:36.924842 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:36.929983 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:36.959518 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 119725us
I20260503 07:58:36.934837 27956 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
W20260503 07:58:36.960644 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 49695.6us
W20260503 07:58:37.016145 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 207280us
W20260503 07:58:37.027408 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 66089.4us
I20260503 07:58:37.040463 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:36.895092 30876 consensus_queue.cc:1048] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260503 07:58:37.046490 28103 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:37.044554 28109 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:36.917810 28613 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
W20260503 07:58:37.073596 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 56753.5us
I20260503 07:58:36.958760 30749 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:36.983184 30884 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260503 07:58:37.213466 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:38.044824 27999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.061s user 0.024s sys 0.008s
W20260503 07:58:37.883756 28033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s user 0.018s sys 0.038s
I20260503 07:58:37.266176 28031 raft_consensus.cc:1275] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260503 07:58:37.041196 30857 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.072578 27958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41856 (request call id 433) took 1147 ms. Trace:
W20260503 07:58:38.050369 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 976109us
I20260503 07:58:38.067981 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2178) took 1225 ms. Trace:
W20260503 07:58:38.068437 27999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s user 0.028s sys 0.008s
W20260503 07:58:38.068513 28033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.211s user 0.018s sys 0.047s
I20260503 07:58:38.074577 27953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2450) took 1126 ms. Trace:
W20260503 07:58:38.052434 28001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s user 0.010s sys 0.003s
I20260503 07:58:38.073509 28031 rpcz_store.cc:276] 0503 07:58:36.842313 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:37.259790 (+417477us) service_pool.cc:224] Handling call
0503 07:58:37.260301 (+ 511us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.067751 (+807450us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.067928 (+ 177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:37.415531 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:37.170047 30958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s user 0.000s sys 0.009s
I20260503 07:58:37.041263 30730 raft_consensus.cc:493] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:38.076046 28001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s user 0.010s sys 0.003s
I20260503 07:58:38.084596 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 542) took 1226 ms. Trace:
W20260503 07:58:37.452621 30977 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.600s user 0.000s sys 0.001s
W20260503 07:58:37.379844 30988 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
W20260503 07:58:37.838289 30964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s user 0.031s sys 0.077s
I20260503 07:58:37.051631 30982 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:37.050936 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:38.075534 27953 rpcz_store.cc:276] 0503 07:58:36.921623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.926372 (+ 4749us) service_pool.cc:224] Handling call
0503 07:58:36.926644 (+ 272us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:36.984907 (+ 58263us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.048083 (+1063176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:37.469933 30985 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.419s user 0.000s sys 0.000s
I20260503 07:58:38.073103 27958 rpcz_store.cc:276] 0503 07:58:36.925415 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.070742 (+1145327us) service_pool.cc:224] Handling call
0503 07:58:38.071564 (+ 822us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.071999 (+ 435us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.072060 (+ 61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.072139 (+ 79us) raft_consensus.cc:1645] Marking committed up to 8
0503 07:58:38.072213 (+ 74us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.072368 (+ 155us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.072512 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:38.087586 28031 rpcz_store.cc:276] 0503 07:58:36.858625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.083787 (+1225162us) service_pool.cc:224] Handling call
0503 07:58:38.084090 (+ 303us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.084266 (+ 176us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.084297 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.084342 (+ 45us) raft_consensus.cc:1645] Marking committed up to 8
0503 07:58:38.084378 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.084444 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.084546 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:37.053610 30591 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260503 07:58:38.049417 30845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.156s user 0.018s sys 0.019s
I20260503 07:58:37.054163 30951 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:37.341161 30377 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:37.165953 30948 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:37.495543 30777 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.060765 30884 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:38.053808 30965 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
W20260503 07:58:38.087220 30958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.450s user 0.003s sys 0.035s
I20260503 07:58:38.108441 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 543) took 1198 ms. Trace:
I20260503 07:58:37.050860 30752 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:38.110081 28105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.060s user 0.022s sys 0.044s
W20260503 07:58:38.148444 28105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s user 0.022s sys 0.044s
I20260503 07:58:38.078364 30981 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:37.496236 30812 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.083576 30857 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.103559 30964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.222s user 0.031s sys 0.090s
I20260503 07:58:38.054749 30749 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:38.143252 28031 rpcz_store.cc:276] 0503 07:58:36.910392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.107735 (+1197343us) service_pool.cc:224] Handling call
0503 07:58:38.108004 (+ 269us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.108157 (+ 153us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.108180 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.108220 (+ 40us) raft_consensus.cc:1645] Marking committed up to 8
0503 07:58:38.108252 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.108309 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.108400 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:38.159051 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2180) took 1185 ms. Trace:
I20260503 07:58:38.159432 28031 rpcz_store.cc:276] 0503 07:58:36.973818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.158154 (+1184336us) service_pool.cc:224] Handling call
0503 07:58:38.158477 (+ 323us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.158668 (+ 191us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.158700 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.158785 (+ 85us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:38.158830 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.158890 (+ 60us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.158998 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:38.110376 30845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.217s user 0.020s sys 0.020s
I20260503 07:58:37.480599 30861 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.110917 30591 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.155041 28102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43222 (request call id 1764) took 2098 ms. Trace:
I20260503 07:58:38.108618 30543 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:37.050614 30960 consensus_queue.cc:237] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.099617 30730 raft_consensus.cc:515] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.180663 28102 rpcz_store.cc:276] 0503 07:58:36.056380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.057098 (+ 718us) service_pool.cc:224] Handling call
0503 07:58:36.057406 (+ 308us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:36.401994 (+344588us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:36.402045 (+ 51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:36.425542 (+ 23497us) log.cc:844] Serialized 26 byte log entry
0503 07:58:36.644067 (+218525us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:36.644133 (+ 66us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:36.644219 (+ 86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.154782 (+1510563us) raft_consensus.cc:1685] finished
0503 07:58:38.154811 (+ 29us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.154975 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58593,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":493958,"threads_started":2,"wal-append.queue_time_us":352556}
I20260503 07:58:38.142786 30983 raft_consensus.cc:493] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.150715 30829 raft_consensus.cc:493] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.151737 30884 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:38.169800 30858 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.112442 30991 consensus_queue.cc:1048] T d9cb650978e344c697c44de57e4393e6 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260503 07:58:38.183257 30859 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.184628 30591 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:38.210508 28026 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.157s user 0.006s sys 0.020s
I20260503 07:58:38.116185 30377 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.213189 27952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.163s user 0.007s sys 0.019s
I20260503 07:58:38.115288 30951 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.155233 30752 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.220955 27954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s user 0.015s sys 0.008s
I20260503 07:58:38.154917 30965 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.168656 30981 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:38.219708 28035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.056s user 0.005s sys 0.020s
I20260503 07:58:38.186520 30964 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:38.190614 28618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51178 (request call id 282) took 1258 ms (client timeout 1641 ms). Trace:
W20260503 07:58:38.237958 28035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s user 0.005s sys 0.021s
W20260503 07:58:38.223304 28583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s user 0.000s sys 0.027s
I20260503 07:58:38.201503 30995 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.208779 30829 raft_consensus.cc:515] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.152771 30777 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:38.230548 28026 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.177s user 0.006s sys 0.020s
W20260503 07:58:38.213164 28582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.004s sys 0.009s
W20260503 07:58:38.231300 27952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.181s user 0.007s sys 0.020s
W20260503 07:58:38.229568 28584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s user 0.005s sys 0.025s
W20260503 07:58:38.234177 28027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.018s user 0.067s sys 0.068s
I20260503 07:58:38.238844 31001 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:38.296890 28584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s user 0.005s sys 0.025s
W20260503 07:58:38.297040 28027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.081s user 0.067s sys 0.069s
W20260503 07:58:38.237104 31003 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.645s user 0.000s sys 0.028s
W20260503 07:58:38.210354 28613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s user 0.008s sys 0.014s
W20260503 07:58:38.297928 28613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s user 0.009s sys 0.014s
W20260503 07:58:38.298049 30989 log.cc:927] Time spent T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.093s user 0.001s sys 0.000s
I20260503 07:58:38.298480 31010 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.109153 30982 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.227456 27998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s user 0.024s sys 0.057s
W20260503 07:58:38.299454 27998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s user 0.024s sys 0.057s
I20260503 07:58:38.299031 31010 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:38.235428 27954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s user 0.015s sys 0.008s
I20260503 07:58:38.301025 30982 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.301153 27954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41856 (request call id 431) took 1380 ms. Trace:
W20260503 07:58:38.239918 28583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s user 0.000s sys 0.028s
I20260503 07:58:38.301506 30982 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.302196 30982 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.231485 30557 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.930s user 0.010s sys 0.020s
W20260503 07:58:38.303191 30557 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.032s user 0.010s sys 0.020s
I20260503 07:58:38.303928 30982 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.304271 30962 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.306205 30957 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.307399 30957 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.307760 30957 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.253072 28108 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 416) took 1962 ms. Trace:
I20260503 07:58:38.248791 30995 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.254057 31005 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:38.239430 28618 rpcz_store.cc:269] 0503 07:58:36.926622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.931135 (+ 4513us) service_pool.cc:224] Handling call
0503 07:58:38.180759 (+1249624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:38.317821 30730 leader_election.cc:290] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.236902 31019 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.318315 31013 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.230438 30858 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.256013 30377 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.233639 30859 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.206197 30983 raft_consensus.cc:515] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.301447 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:58:38.253391 30994 log.cc:927] Time spent T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.103s user 0.001s sys 0.000s
I20260503 07:58:38.310465 28026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2175) took 1562 ms. Trace:
I20260503 07:58:38.301486 27954 rpcz_store.cc:276] 0503 07:58:36.920618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.925089 (+ 4471us) service_pool.cc:224] Handling call
0503 07:58:36.925336 (+ 247us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:37.185556 (+260220us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:37.185610 (+ 54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:37.219526 (+ 33916us) log.cc:844] Serialized 26 byte log entry
0503 07:58:38.300827 (+1081301us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:38.300866 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.300925 (+ 59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.300960 (+ 35us) raft_consensus.cc:1685] finished
0503 07:58:38.300970 (+ 10us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.301086 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1101956,"raft.queue_time_us":273143,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":39375,"thread_start_us":970765,"threads_started":1,"wal-append.queue_time_us":991942}
I20260503 07:58:38.317588 30749 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:38.336454 30749 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.336927 30749 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.338156 31009 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:38.309674 28582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s user 0.004s sys 0.009s
I20260503 07:58:38.309237 28108 rpcz_store.cc:276] 0503 07:58:36.290678 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.290800 (+ 122us) service_pool.cc:224] Handling call
0503 07:58:36.291144 (+ 344us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:36.520740 (+229596us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:36.520788 (+ 48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:36.521306 (+ 518us) log.cc:844] Serialized 26 byte log entry
0503 07:58:36.760280 (+238974us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:36.760334 (+ 54us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.252664 (+1492330us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540024fed4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:38.252718 (+ 54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.252760 (+ 42us) raft_consensus.cc:1685] finished
0503 07:58:38.252773 (+ 13us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.252990 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1926,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6878,"spinlock_wait_cycles":527148800,"thread_start_us":211216,"threads_started":1,"wal-append.queue_time_us":363681,"wal-append.run_cpu_time_us":1330,"wal-append.run_wall_time_us":1001362}
I20260503 07:58:38.317551 31025 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.318926 28027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43620 (request call id 541) took 1485 ms. Trace:
W20260503 07:58:38.331240 31000 log.cc:927] Time spent T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.104s user 0.000s sys 0.000s
I20260503 07:58:38.241642 30964 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.332649 28030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2179) took 1490 ms. Trace:
I20260503 07:58:38.341872 28033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1456) took 1566 ms. Trace:
I20260503 07:58:38.339915 28027 rpcz_store.cc:276] 0503 07:58:36.833361 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.918791 (+ 85430us) service_pool.cc:224] Handling call
0503 07:58:36.919045 (+ 254us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:36.919407 (+ 362us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:36.919441 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:37.215698 (+296257us) log.cc:844] Serialized 26 byte log entry
0503 07:58:38.297581 (+1081883us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:38.297629 (+ 48us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.297714 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.318740 (+ 21026us) raft_consensus.cc:1685] finished
0503 07:58:38.318756 (+ 16us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.318878 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13791,"raft.queue_time_us":5801,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":53035,"thread_start_us":1081522,"threads_started":1,"wal-append.queue_time_us":1101721}
I20260503 07:58:38.345813 28030 rpcz_store.cc:276] 0503 07:58:36.842623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:37.334727 (+492104us) service_pool.cc:224] Handling call
0503 07:58:38.050868 (+716141us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:38.109544 (+ 58676us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.109611 (+ 67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:38.115861 (+ 6250us) log.cc:844] Serialized 26 byte log entry
0503 07:58:38.296197 (+180336us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:38.296368 (+ 171us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.296429 (+ 61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.332415 (+ 35986us) raft_consensus.cc:1685] finished
0503 07:58:38.332442 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.332584 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4711,"raft.queue_time_us":157927,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":12289,"thread_start_us":208374,"threads_started":2,"wal-append.queue_time_us":214881}
I20260503 07:58:38.299117 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:38.339913 28105 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 418) took 1429 ms. Trace:
I20260503 07:58:38.346403 28033 rpcz_store.cc:276] 0503 07:58:36.775511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.775920 (+ 409us) service_pool.cc:224] Handling call
0503 07:58:36.776223 (+ 303us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:36.798233 (+ 22010us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:36.798275 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:36.804909 (+ 6634us) log.cc:844] Serialized 26 byte log entry
0503 07:58:38.074034 (+1269125us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:38.098825 (+ 24791us) log.cc:844] Serialized 14 byte log entry
0503 07:58:38.294600 (+195775us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.294686 (+ 86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.340318 (+ 45632us) raft_consensus.cc:1685] finished
0503 07:58:38.340335 (+ 17us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.341819 (+ 1484us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40491,"prepare.queue_time_us":29114,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":176859,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":11185,"thread_start_us":1412139,"threads_started":2,"wal-append.queue_time_us":1254344}
I20260503 07:58:38.350103 28105 rpcz_store.cc:276] 0503 07:58:36.910678 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.910846 (+ 168us) service_pool.cc:224] Handling call
0503 07:58:36.983436 (+ 72590us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:37.041664 (+ 58228us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:37.041709 (+ 45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:37.049873 (+ 8164us) log.cc:844] Serialized 26 byte log entry
0503 07:58:38.148879 (+1099006us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:38.148918 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.148982 (+ 64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.339733 (+190751us) raft_consensus.cc:1685] finished
0503 07:58:38.339751 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.339859 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61685,"raft.queue_time_us":60762,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":1098658,"threads_started":1,"wal-append.queue_time_us":1174094}
I20260503 07:58:38.318789 31013 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:38.352982 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 54019us
I20260503 07:58:38.340992 30639 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.295885 30978 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:38.342787 31003 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.752s user 0.000s sys 0.029s
I20260503 07:58:38.354074 30749 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:38.363158 28109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43222 (request call id 1777) took 1450 ms (client timeout 1641 ms). Trace:
I20260503 07:58:38.339116 31009 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.375555 28109 rpcz_store.cc:269] 0503 07:58:36.912401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.913934 (+ 1533us) service_pool.cc:224] Handling call
0503 07:58:38.362953 (+1449019us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000186d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:38.363083 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249290496}
I20260503 07:58:38.353957 30993 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.381278 31021 raft_consensus.cc:493] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
W20260503 07:58:38.385454 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 85080.6us
I20260503 07:58:38.354765 28613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51168 (request call id 341) took 1139 ms. Trace:
W20260503 07:58:38.377482 30864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s user 0.005s sys 0.006s
I20260503 07:58:38.392295 31023 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.369822 30713 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.378348 30857 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.318500 31019 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.397329 30864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s user 0.005s sys 0.006s
I20260503 07:58:38.374130 30639 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.417357 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.417995 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.388319 30957 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.388899 31010 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.319924 31001 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.396802 30749 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:38.421693 28104 raft_consensus.cc:2393] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 11: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:38.398798 30730 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.428725 28102 raft_consensus.cc:1275] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:38.425436 28108 raft_consensus.cc:1275] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:38.401268 30982 raft_consensus.cc:493] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.401118 30924 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.436287 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.328534 31005 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.436961 31031 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.339496 31025 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.440717 31024 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.441188 31024 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.426723 30960 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:38.428186 30857 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.447321 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.447805 28102 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:38.428539 30749 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.451808 31001 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.390859 30993 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.419210 30713 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.376291 30978 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.441906 30951 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.463737 28102 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:38.438102 30924 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.435559 30730 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.454250 30749 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:38.436604 30982 raft_consensus.cc:515] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.437479 31031 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.402061 31021 raft_consensus.cc:515] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:38.477005 30971 log.cc:927] Time spent T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 1.915s user 0.006s sys 0.008s
I20260503 07:58:38.476887 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.453984 30857 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.477795 30993 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.458499 30777 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.424794 31023 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.486089 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:38.486716 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:38.492081 30949 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.463016 30870 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.494185 30982 leader_election.cc:290] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.494309 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1455) took 1719 ms. Trace:
I20260503 07:58:38.483053 30965 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.495505 28035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33288 (request call id 1461) took 1716 ms. Trace:
I20260503 07:58:38.501322 28100 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 5.
I20260503 07:58:38.477226 31028 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.453040 30960 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.505062 30995 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.506708 28104 raft_consensus.cc:1275] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:38.510495 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.482458 30981 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.512667 28034 rpcz_store.cc:276] 0503 07:58:36.774601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.775354 (+ 753us) service_pool.cc:224] Handling call
0503 07:58:36.775573 (+ 219us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:36.904738 (+129165us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:36.904773 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:36.904808 (+ 35us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:36.904840 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.494058 (+1589218us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002206d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:38.494108 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.494246 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296674176}
I20260503 07:58:38.511721 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.516343 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.497960 30983 leader_election.cc:290] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.504037 31010 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.512857 28035 rpcz_store.cc:276] 0503 07:58:36.778641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.797311 (+ 18670us) service_pool.cc:224] Handling call
0503 07:58:36.797647 (+ 336us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:36.918247 (+120600us) raft_consensus.cc:1534] Early marking committed up to index 8
0503 07:58:37.132022 (+213775us) log.cc:844] Serialized 14 byte log entry
0503 07:58:38.239592 (+1107570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.239640 (+ 48us) raft_consensus.cc:1645] Marking committed up to 8
0503 07:58:38.239682 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.495304 (+255622us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000dacd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:38.495348 (+ 44us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.495456 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466676,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":17627,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"spinlock_wait_cycles":276988160,"thread_start_us":1320766,"threads_started":2,"wal-append.queue_time_us":1309869}
I20260503 07:58:38.503950 30858 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.484313 30859 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:38.522909 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 165530us
I20260503 07:58:38.531311 27952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45176 (request call id 1737) took 1617 ms. Trace:
I20260503 07:58:38.542683 31005 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.526343 30995 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.533595 31024 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.521590 31010 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.534718 31009 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.518833 30993 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260503 07:58:38.519781 30991 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260503 07:58:38.389206 28613 rpcz_store.cc:276] 0503 07:58:37.215590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:37.259617 (+ 44027us) service_pool.cc:224] Handling call
0503 07:58:37.413874 (+154257us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:37.542609 (+128735us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:37.542659 (+ 50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:37.543312 (+ 653us) log.cc:844] Serialized 26 byte log entry
0503 07:58:38.298292 (+754980us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:38.298331 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.298393 (+ 62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.309378 (+ 10985us) raft_consensus.cc:1685] finished
0503 07:58:38.315040 (+ 5662us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.347397 (+ 32357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83809,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":754580,"threads_started":1,"wal-append.queue_time_us":761667}
I20260503 07:58:38.520455 30964 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.564924 31005 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.544421 30981 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.529740 31013 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.595558 31005 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.560499 30965 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:38.524809 30949 raft_consensus.cc:493] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.540318 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.542045 27952 rpcz_store.cc:276] 0503 07:58:36.914097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.914230 (+ 133us) service_pool.cc:224] Handling call
0503 07:58:36.983262 (+ 69032us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:36.983468 (+ 206us) raft_consensus.cc:1534] Early marking committed up to index 6
0503 07:58:37.050360 (+ 66892us) log.cc:844] Serialized 14 byte log entry
0503 07:58:38.526749 (+1476389us) log.cc:844] Serialized 14 byte log entry
0503 07:58:38.530922 (+ 4173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.530992 (+ 70us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:38.531052 (+ 60us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.531128 (+ 76us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.531247 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28357,"prepare.queue_time_us":69892,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":41,"raft.queue_time_us":52810,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":15442,"thread_start_us":1452598,"threads_started":2,"wal-append.queue_time_us":1235533}
I20260503 07:58:38.529254 30951 raft_consensus.cc:493] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.559788 30982 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.562500 30639 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.624392 28106 raft_consensus.cc:2468] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:38.647397 31021 leader_election.cc:290] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:38.652451 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:38.564169 30995 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:38.622009 30972 log.cc:927] Time spent T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 2.040s user 0.001s sys 0.010s
I20260503 07:58:38.599010 30713 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.576431 31024 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.622118 30868 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.544353 28101 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260503 07:58:38.622475 30730 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.520071 30870 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.680317 30960 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.677258 31031 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.679311 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.591601 31009 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:38.623013 30924 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.621896 31020 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.681555 30870 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.688275 31024 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.711730 30868 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.724172 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.819315 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.616676 30981 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.659721 31025 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.623557 30965 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.526402 31028 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.662964 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:38.722282 31030 log.cc:927] Time spent T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
I20260503 07:58:38.660073 30949 raft_consensus.cc:515] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.660218 30951 raft_consensus.cc:515] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.823339 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.778223 31031 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:38.832336 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.846439 28106 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 11.
I20260503 07:58:38.847440 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.848551 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:38.721220 30982 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:38.834447 30981 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.837510 31019 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.777208 31032 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:38.840406 28101 raft_consensus.cc:2468] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:38.775923 30978 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.823455 30857 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.817737 31009 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:38.824183 31020 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:39.238344 28001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s user 0.022s sys 0.027s
I20260503 07:58:38.867476 27951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2452) took 1888 ms. Trace:
I20260503 07:58:39.326970 27951 rpcz_store.cc:276] 0503 07:58:36.979306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.866578 (+1887272us) service_pool.cc:224] Handling call
0503 07:58:38.866931 (+ 353us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.867118 (+ 187us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.867151 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.867200 (+ 49us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:38.867249 (+ 49us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.867310 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.867418 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:39.131693 28074 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:39.328555 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:39.208981 28582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s user 0.004s sys 0.014s
W20260503 07:58:39.329325 28582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s user 0.004s sys 0.016s
I20260503 07:58:39.329797 31040 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:39.329969 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:39.330240 31020 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:39.330308 31040 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:39.331286 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:39.288757 30870 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:39.332414 31040 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:39.332508 30870 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:39.332470 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:38.868337 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:39.221324 30951 leader_election.cc:290] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:39.334470 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:39.266762 28622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.767s user 0.005s sys 0.013s
W20260503 07:58:39.335234 28622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s user 0.006s sys 0.014s
I20260503 07:58:39.335529 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:39.238313 30868 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:39.336270 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:39.208783 28585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s user 0.003s sys 0.015s
W20260503 07:58:39.085243 28107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s user 0.022s sys 0.048s
W20260503 07:58:39.337491 28107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s user 0.025s sys 0.054s
W20260503 07:58:39.220707 28105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s user 0.000s sys 0.018s
W20260503 07:58:39.339030 28105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s user 0.001s sys 0.019s
W20260503 07:58:39.339373 28001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s user 0.022s sys 0.031s
I20260503 07:58:38.884239 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:39.339984 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:39.086110 28000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s user 0.033s sys 0.045s
I20260503 07:58:39.336901 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:39.340651 28000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s user 0.034s sys 0.045s
I20260503 07:58:39.341064 27951 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:39.333216 27960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41856 (request call id 434) took 2402 ms. Trace:
W20260503 07:58:39.234853 27924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s user 0.022s sys 0.042s
W20260503 07:58:39.342339 27924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s user 0.023s sys 0.043s
I20260503 07:58:39.087730 30965 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:38.908480 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:39.342747 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 826503us
I20260503 07:58:39.343225 27957 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
W20260503 07:58:39.208631 28075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s user 0.006s sys 0.012s
W20260503 07:58:39.344038 28075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s user 0.008s sys 0.013s
W20260503 07:58:39.337167 28585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s user 0.004s sys 0.017s
I20260503 07:58:39.335155 30870 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:39.340262 27958 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:39.341817 27960 rpcz_store.cc:276] 0503 07:58:36.930981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:39.332482 (+2401501us) service_pool.cc:224] Handling call
0503 07:58:39.332740 (+ 258us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:39.332904 (+ 164us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:39.332930 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:39.332977 (+ 47us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:39.333009 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:39.333082 (+ 73us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:39.333170 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:39.344730 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:39.351315 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:39.351339 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:39.362782 28073 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.795s user 0.005s sys 0.021s
I20260503 07:58:39.340226 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:39.363188 28073 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.796s user 0.005s sys 0.021s
W20260503 07:58:39.363679 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 796175us
I20260503 07:58:39.334335 28618 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:39.359572 27957 raft_consensus.cc:1275] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260503 07:58:39.364948 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:38.831430 31025 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:38.923281 31010 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:39.366191 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:39.309494 30993 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:38.914737 28613 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260503 07:58:38.946079 30884 consensus_meta.cc:287] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 0.713s user 0.005s sys 0.005s
I20260503 07:58:38.899622 30949 leader_election.cc:290] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.998052 31005 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.900916 30982 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:38.897828 30995 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:39.282043 31028 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:39.013514 31023 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:38.872468 31031 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.030540 27957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2459) took 1115 ms. Trace:
I20260503 07:58:39.575973 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.032548 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:39.984784 30847 raft_consensus.cc:493] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.033420 27951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45178 (request call id 2460) took 1110 ms. Trace:
I20260503 07:58:39.368327 30951 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
W20260503 07:58:39.499063 27999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s user 0.009s sys 0.008s
I20260503 07:58:40.033845 30847 raft_consensus.cc:515] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.034410 30993 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:39.360942 30978 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:39.895354 28102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.394s user 0.012s sys 0.017s
I20260503 07:58:40.036365 30847 leader_election.cc:290] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.036585 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:39.849545 28614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:39.416137 28620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:39.367947 31019 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:39.536718 31024 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:39.976743 28622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s user 0.011s sys 0.013s
I20260503 07:58:40.038892 28617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:39.570842 28107 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1737) took 1147 ms. Trace:
W20260503 07:58:39.498929 27959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s user 0.018s sys 0.012s
W20260503 07:58:40.040987 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 324877us
I20260503 07:58:39.905917 27955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2451) took 2978 ms. Trace:
W20260503 07:58:40.036221 28102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.536s user 0.012s sys 0.023s
W20260503 07:58:40.034873 27999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.462s user 0.010s sys 0.016s
W20260503 07:58:40.043915 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 1.4706e+06us
I20260503 07:58:40.044718 27999 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:39.576066 27956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45176 (request call id 1743) took 2548 ms (client timeout 2165 ms). Trace:
W20260503 07:58:40.049911 27956 rpcz_store.cc:269] 0503 07:58:37.027523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:39.575886 (+2548363us) service_pool.cc:211] Skipping call since client already timed out
0503 07:58:39.576003 (+ 117us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260503 07:58:40.040827 27959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.245s user 0.025s sys 0.030s
I20260503 07:58:40.040064 28107 rpcz_store.cc:276] 0503 07:58:38.423793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.423887 (+ 94us) service_pool.cc:224] Handling call
0503 07:58:38.426463 (+ 2576us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:38.430301 (+ 3838us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.430341 (+ 40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:38.433891 (+ 3550us) log.cc:844] Serialized 26 byte log entry
0503 07:58:39.338217 (+904326us) raft_consensus.cc:1645] Marking committed up to 8
0503 07:58:39.338267 (+ 50us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:39.338350 (+ 83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:39.570622 (+232272us) raft_consensus.cc:1685] finished
0503 07:58:39.570645 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:39.570780 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3470,"raft.queue_time_us":16862,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":883466,"threads_started":1,"wal-append.queue_time_us":1124759}
I20260503 07:58:40.056294 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.057076 27952 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:40.036209 30978 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:40.094411 27924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s user 0.009s sys 0.013s
I20260503 07:58:40.031167 27957 rpcz_store.cc:276] 0503 07:58:38.914674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:39.358172 (+443498us) service_pool.cc:224] Handling call
0503 07:58:39.359226 (+ 1054us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:40.030304 (+671078us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.030488 (+ 184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:40.094825 27924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s user 0.009s sys 0.013s
I20260503 07:58:40.095352 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.033723 27951 rpcz_store.cc:276] 0503 07:58:38.923296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:39.341626 (+418330us) service_pool.cc:224] Handling call
0503 07:58:40.033370 (+691744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:40.096565 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.097230 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:40.044059 28073 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.42.1:34525 timed out after 1.871s (SENT) [suppressed 5 similar messages]
I20260503 07:58:40.097657 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:40.098227 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 54192.1us
I20260503 07:58:40.098439 27957 raft_consensus.cc:2410] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260503 07:58:40.098987 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:39.623646 28032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2168) took 3089 ms. Trace:
I20260503 07:58:38.335004 28026 rpcz_store.cc:276] 0503 07:58:36.748078 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.748183 (+ 105us) service_pool.cc:224] Handling call
0503 07:58:36.748442 (+ 259us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:36.757358 (+ 8916us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:36.757384 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:36.758024 (+ 640us) log.cc:844] Serialized 26 byte log entry
0503 07:58:36.931869 (+173845us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:38.292947 (+1361078us) log.cc:844] Serialized 14 byte log entry
0503 07:58:38.293210 (+ 263us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:38.293296 (+ 86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:38.310288 (+ 16992us) raft_consensus.cc:1685] finished
0503 07:58:38.310307 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:38.310417 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131619,"prepare.queue_time_us":548510,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":9045,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":62207,"thread_start_us":1412710,"threads_started":2,"wal-append.queue_time_us":1414807}
I20260503 07:58:40.041949 27955 rpcz_store.cc:276] 0503 07:58:36.927079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:39.904919 (+2977840us) service_pool.cc:224] Handling call
0503 07:58:39.905300 (+ 381us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:39.905489 (+ 189us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:39.905522 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:39.905572 (+ 50us) raft_consensus.cc:1645] Marking committed up to 6
0503 07:58:39.905660 (+ 88us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:39.905731 (+ 71us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:39.905860 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260503 07:58:40.039072 28622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s user 0.012s sys 0.014s
I20260503 07:58:40.102785 28622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51194 (request call id 370) took 1642 ms. Trace:
I20260503 07:58:40.092759 28109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59398 (request call id 419) took 1690 ms. Trace:
I20260503 07:58:40.100503 28032 rpcz_store.cc:276] 0503 07:58:36.534272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.535189 (+ 917us) service_pool.cc:224] Handling call
0503 07:58:36.546061 (+ 10872us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:36.886825 (+340764us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:39.623328 (+2736503us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540026c354. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:39.623529 (+ 201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699077504}
I20260503 07:58:40.103688 28109 rpcz_store.cc:276] 0503 07:58:38.402127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.402252 (+ 125us) service_pool.cc:224] Handling call
0503 07:58:38.402529 (+ 277us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.508191 (+105662us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.508218 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.508252 (+ 34us) raft_consensus.cc:1645] Marking committed up to 10
0503 07:58:38.508279 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.092539 (+1584260us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540027ae54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:40.092585 (+ 46us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.092696 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242652032}
I20260503 07:58:40.104905 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.105914 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.106647 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.107038 27955 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:40.107595 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.108290 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.099159 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.109184 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:40.101845 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 57223.1us
I20260503 07:58:40.110164 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:40.111411 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.111979 27951 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:40.113523 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.112700 30993 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:40.095198 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 751704us
I20260503 07:58:40.034451 30951 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.103539 28622 rpcz_store.cc:276] 0503 07:58:38.460430 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.461768 (+ 1338us) service_pool.cc:224] Handling call
0503 07:58:38.473761 (+ 11993us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.473918 (+ 157us) raft_consensus.cc:1534] Early marking committed up to index 8
0503 07:58:39.335779 (+861861us) log.cc:844] Serialized 14 byte log entry
0503 07:58:40.102467 (+766688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:40.102519 (+ 52us) raft_consensus.cc:1645] Marking committed up to 8
0503 07:58:40.102557 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.102635 (+ 78us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.102731 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1092135,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":1602019,"threads_started":2}
W20260503 07:58:40.154278 27960 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s user 0.014s sys 0.030s
W20260503 07:58:40.154774 27960 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s user 0.014s sys 0.030s
I20260503 07:58:39.362025 30857 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:39.637928 30591 consensus_meta.cc:287] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1: Time spent flushing consensus metadata: real 1.401s user 0.011s sys 0.000s
W20260503 07:58:39.601250 30749 consensus_meta.cc:287] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413: Time spent flushing consensus metadata: real 1.118s user 0.009s sys 0.002s
I20260503 07:58:39.370466 30965 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:39.364197 30870 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
W20260503 07:58:39.905931 28615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s user 0.005s sys 0.015s
W20260503 07:58:40.039093 30882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.132s user 0.025s sys 0.013s
I20260503 07:58:40.037992 31019 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.156402 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:40.193483 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 83358.6us
I20260503 07:58:40.095175 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.017401 31009 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.198625 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:39.550925 30981 raft_consensus.cc:493] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:40.188566 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:39.564893 31041 raft_consensus.cc:493] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:39.627902 30900 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:40.191584 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:40.192020 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 97721.2us
I20260503 07:58:40.192389 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:39.665781 30861 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:40.160148 27924 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:40.193398 30882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.287s user 0.025s sys 0.013s
W20260503 07:58:40.196663 27954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s user 0.018s sys 0.018s
I20260503 07:58:40.199909 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:40.213344 28035 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:40.201838 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:40.214200 28032 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:40.188984 31005 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260503 07:58:40.208046 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 47970.4us
W20260503 07:58:40.215440 27954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s user 0.018s sys 0.019s
W20260503 07:58:40.193872 28615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s user 0.007s sys 0.018s
I20260503 07:58:40.209640 27951 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260503 07:58:40.189256 30965 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:39.368034 31020 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.822s
I20260503 07:58:40.222007 27959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2449) took 3300 ms. Trace:
I20260503 07:58:40.210310 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.192538 28613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51178 (request call id 283) took 1413 ms. Trace:
I20260503 07:58:39.368853 31032 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.226573 31022 consensus_queue.cc:1048] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:40.195694 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:40.195742 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.215018 30993 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:40.224687 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.216931 30861 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.215034 30900 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.101836 31025 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.101962 30884 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.201563 31023 raft_consensus.cc:2804] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:40.232153 27959 rpcz_store.cc:276] 0503 07:58:36.921378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.922653 (+ 1275us) service_pool.cc:224] Handling call
0503 07:58:36.922991 (+ 338us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:37.053719 (+130728us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:37.053760 (+ 41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:37.054165 (+ 405us) log.cc:844] Serialized 26 byte log entry
0503 07:58:38.795566 (+1741401us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18000cf9a0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850a4ed251 00007f850a4f9ab1 00007f8501669587 00007f850a462bc9 00007f8501685cdb 00007f8501683f7f 00007f8501686242 00007f85042bd5ab 00007f85042c30c3 00007f85042c3471 00007f85046dfdef
0503 07:58:40.052787 (+1257221us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:40.052838 (+ 51us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.052923 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:40.221657 (+168734us) raft_consensus.cc:1685] finished
0503 07:58:40.221681 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.221925 (+ 244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1037558,"raft.queue_time_us":130498,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":113008,"spinlock_wait_cycles":42706816,"thread_start_us":1257006,"threads_started":1,"wal-append.queue_time_us":3165259}
I20260503 07:58:40.192811 30857 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.211463 30981 raft_consensus.cc:515] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.192889 30591 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.193291 30749 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.217836 31005 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:40.228289 30965 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:40.243157 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:40.200305 30870 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.201655 31028 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260503 07:58:40.236418 30993 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:40.272274 30857 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.272591 30870 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.272989 31031 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.273875 30900 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.275000 30951 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.275873 30978 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.276108 30861 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.276196 31019 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.211651 31041 raft_consensus.cc:515] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.248986 31032 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.237818 31052 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260503 07:58:40.270848 31009 raft_consensus.cc:2804] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:40.280485 31052 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:40.280745 31009 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.281004 31052 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:40.281338 31009 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:40.273900 30981 leader_election.cc:290] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.268117 31005 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:40.246905 31023 raft_consensus.cc:493] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.232997 28613 rpcz_store.cc:276] 0503 07:58:38.776015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.778509 (+ 2494us) service_pool.cc:224] Handling call
0503 07:58:38.831922 (+ 53413us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:40.039320 (+1207398us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.188841 (+149521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260503 07:58:40.249102 30591 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.272305 30993 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:40.267686 31059 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260503 07:58:40.316840 30752 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.286278 31023 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:40.298760 30884 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:40.338850 31050 log.cc:927] Time spent T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.093s user 0.000s sys 0.001s
I20260503 07:58:40.342181 31025 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.342059 30965 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.343300 31041 leader_election.cc:290] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.344214 30965 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.350433 31052 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.351812 31052 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.351377 31023 raft_consensus.cc:515] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:40.229566 27923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s user 0.016s sys 0.070s
W20260503 07:58:40.379846 27923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s user 0.016s sys 0.070s
I20260503 07:58:40.381978 27954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2455) took 1503 ms. Trace:
I20260503 07:58:40.382570 27954 rpcz_store.cc:276] 0503 07:58:38.878750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.879344 (+ 594us) service_pool.cc:224] Handling call
0503 07:58:38.879699 (+ 355us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:38.880083 (+ 384us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.880121 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:39.339482 (+459361us) log.cc:844] Serialized 26 byte log entry
0503 07:58:40.216198 (+876716us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:40.216238 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.216300 (+ 62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:40.381261 (+164961us) raft_consensus.cc:1685] finished
0503 07:58:40.381328 (+ 67us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.381714 (+ 386us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":258,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":876400,"threads_started":1,"wal-append.queue_time_us":927132}
W20260503 07:58:40.385257 27953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.454s user 0.001s sys 0.014s
W20260503 07:58:40.385721 27953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.455s user 0.001s sys 0.014s
I20260503 07:58:40.387148 27953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45178 (request call id 2457) took 1495 ms. Trace:
I20260503 07:58:40.387482 27953 rpcz_store.cc:276] 0503 07:58:38.891847 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.892084 (+ 237us) service_pool.cc:224] Handling call
0503 07:58:38.892386 (+ 302us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.892647 (+ 261us) raft_consensus.cc:1534] Early marking committed up to index 7
0503 07:58:38.930726 (+ 38079us) log.cc:844] Serialized 14 byte log entry
0503 07:58:40.386534 (+1455808us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:40.386648 (+ 114us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:40.386781 (+ 133us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.386910 (+ 129us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.387098 (+ 188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41172,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":1455066,"threads_started":1,"wal-append.queue_time_us":1366508}
I20260503 07:58:40.270196 28034 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 5.
I20260503 07:58:40.396088 30990 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:40.397725 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 201471us
I20260503 07:58:40.397403 30990 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.401253 30990 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:40.401515 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 189968us
I20260503 07:58:40.401934 30990 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:40.403103 28615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51168 (request call id 342) took 1521 ms. Trace:
I20260503 07:58:40.402863 30990 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.351444 31009 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:40.405529 30813 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.406421 30813 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.407522 31009 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:40.416365 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.403653 28615 rpcz_store.cc:276] 0503 07:58:38.881065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.881366 (+ 301us) service_pool.cc:224] Handling call
0503 07:58:38.881698 (+ 332us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.881923 (+ 225us) raft_consensus.cc:1534] Early marking committed up to index 7
0503 07:58:39.337282 (+455359us) log.cc:844] Serialized 14 byte log entry
0503 07:58:40.292911 (+955629us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:40.402207 (+109296us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:40.402399 (+ 192us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.402548 (+ 149us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.402813 (+ 265us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":684284,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":71945,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":1395121,"threads_started":3,"wal-append.queue_time_us":899358}
I20260503 07:58:40.419216 30966 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.419962 30966 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.421639 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:40.423027 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:40.423542 30591 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.424533 30591 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.390357 27959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:40.427093 27959 raft_consensus.cc:606] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:40.408422 30996 log.cc:927] Time spent T 98c37994a7bf4429b4fff0b9cf211dec P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 2.199s user 0.021s sys 0.036s
I20260503 07:58:40.429554 27856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53082 (request call id 152) took 5802 ms. Trace:
I20260503 07:58:40.436961 30983 raft_consensus.cc:493] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:40.437291 31059 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:40.437537 30818 raft_consensus.cc:493] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:40.437920 30983 raft_consensus.cc:515] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.438366 30818 raft_consensus.cc:515] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.438239 31059 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.440634 30818 leader_election.cc:290] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.430076 27856 rpcz_store.cc:276] 0503 07:58:34.626713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:34.628003 (+ 1290us) service_pool.cc:224] Handling call
0503 07:58:40.429306 (+5801303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:35.629973 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:35.630529 (+ 556us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:35.630563 (+ 34us) write_op.cc:435] Acquired schema lock
0503 07:58:35.630577 (+ 14us) tablet.cc:662] Decoding operations
0503 07:58:35.630900 (+ 323us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:35.630951 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:35.630982 (+ 31us) tablet.cc:685] Acquiring locks for 1 operations
0503 07:58:35.631151 (+ 169us) tablet.cc:701] Row locks acquired
0503 07:58:35.631164 (+ 13us) write_op.cc:260] PREPARE: finished
0503 07:58:35.631304 (+ 140us) write_op.cc:270] Start()
0503 07:58:35.631422 (+ 118us) write_op.cc:276] Timestamp: P: 1777795115631252 usec, L: 0
0503 07:58:35.631438 (+ 16us) op_driver.cc:348] REPLICATION: starting
0503 07:58:35.769340 (+137902us) log.cc:844] Serialized 530 byte log entry
0503 07:58:37.590230 (+1820890us) op_driver.cc:464] REPLICATION: finished
0503 07:58:38.255384 (+665154us) write_op.cc:301] APPLY: starting
0503 07:58:38.255463 (+ 79us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:38.255553 (+ 90us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:38.255697 (+ 144us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:38.255875 (+ 178us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:38.256060 (+ 185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0503 07:58:38.256100 (+ 40us) write_op.cc:312] APPLY: finished
0503 07:58:38.256265 (+ 165us) log.cc:844] Serialized 23 byte log entry
0503 07:58:38.256422 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:38.256493 (+ 71us) write_op.cc:454] Released schema lock
0503 07:58:38.256527 (+ 34us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:38.378078 (+121551us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:38.380695 (+ 2617us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":716459,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":664912,"apply.run_cpu_time_us":1479,"apply.run_wall_time_us":1480,"num_ops":1,"prepare.queue_time_us":181104,"prepare.run_cpu_time_us":46786,"prepare.run_wall_time_us":464354,"raft.queue_time_us":1163291,"raft.run_cpu_time_us":30512,"raft.run_wall_time_us":833584,"replication_time_us":1958627,"thread_start_us":2667589,"threads_started":4,"wal-append.queue_time_us":526649,"wal-append.run_cpu_time_us":43003,"wal-append.run_wall_time_us":3371328}]]}
I20260503 07:58:40.440989 30953 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:40.456480 30953 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.458379 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.458792 30953 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.459018 28106 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:40.459468 30901 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:40.459873 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.460381 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.460276 30901 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.460734 28109 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:40.461357 28106 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 10.
I20260503 07:58:40.461745 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.441396 31067 raft_consensus.cc:493] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.462576 30901 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.463033 31067 raft_consensus.cc:515] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:40.463717 27926 connection.cc:254] RPC call timeout handler was delayed by -1.6756896140000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260503 07:58:40.441807 31020 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.465444 31020 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.446883 28028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43620 (request call id 539) took 3628 ms. Trace:
I20260503 07:58:40.467743 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.467995 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.468122 28028 rpcz_store.cc:276] 0503 07:58:36.817935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.838664 (+ 20729us) service_pool.cc:224] Handling call
0503 07:58:40.446388 (+3607724us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b540024bdd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:40.446622 (+ 234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22027520}
I20260503 07:58:40.450919 30813 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:40.447194 28103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43222 (request call id 1770) took 3659 ms (client timeout 2666 ms). Trace:
I20260503 07:58:40.469566 28034 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43620 (request call id 548) took 1104 ms. Trace:
I20260503 07:58:40.442852 30818 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:40.469995 28034 rpcz_store.cc:276] 0503 07:58:39.364855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:39.365943 (+ 1088us) service_pool.cc:224] Handling call
0503 07:58:40.469237 (+1103294us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540015ac54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:40.469394 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549078912}
I20260503 07:58:40.470548 30818 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.448789 30820 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.471176 30769 consensus_queue.cc:1048] T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260503 07:58:40.471613 30820 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.472572 30818 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.453359 30966 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.453850 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cb650978e344c697c44de57e4393e6" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.455490 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.474756 28101 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:40.459900 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.487674 28107 raft_consensus.cc:2410] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260503 07:58:40.492043 30901 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:40.474936 30983 leader_election.cc:290] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.495437 31023 leader_election.cc:290] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.474220 28585 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:40.497315 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 93239.1us
I20260503 07:58:40.498129 28585 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:40.499701 28585 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:40.499951 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.501482 30956 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:40.501765 31010 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:40.502040 30956 raft_consensus.cc:493] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.502233 31010 raft_consensus.cc:493] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:40.502473 30956 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:40.502606 31010 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:40.448770 30749 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:40.469594 28103 rpcz_store.cc:269] 0503 07:58:36.787350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.787453 (+ 103us) service_pool.cc:224] Handling call
0503 07:58:40.446759 (+3659306us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400018bd4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:40.446940 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579907328}
W20260503 07:58:40.486346 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 75318.8us
I20260503 07:58:40.508394 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.508849 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.509160 27959 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 8.
I20260503 07:58:40.448235 31059 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.514777 30993 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.441088 31022 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:40.518679 31022 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.522444 28031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2181) took 3548 ms. Trace:
I20260503 07:58:40.524946 30820 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.525290 30694 raft_consensus.cc:493] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:40.524811 28031 rpcz_store.cc:276] 0503 07:58:36.974093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.160393 (+1186300us) service_pool.cc:224] Handling call
0503 07:58:38.160664 (+ 271us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.245681 (+ 85017us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.245708 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:38.245754 (+ 46us) raft_consensus.cc:1645] Marking committed up to 5
0503 07:58:38.245788 (+ 34us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.521881 (+2276093us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b54002387d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:40.521953 (+ 72us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.522211 (+ 258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187149184}
I20260503 07:58:40.526252 30694 raft_consensus.cc:515] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.526484 30983 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:40.520993 31022 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.527768 30591 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.528574 30694 leader_election.cc:290] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.529752 27926 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:40.473665 31020 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.528708 30983 consensus_queue.cc:1048] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260503 07:58:40.534833 28100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43228 (request call id 1739) took 2098 ms (client timeout 1594 ms). Trace:
I20260503 07:58:40.536864 31038 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:40.536922 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.537873 28583 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:40.539041 28104 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1743) took 2083 ms. Trace:
I20260503 07:58:40.483863 30990 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.517192 30993 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:40.541522 28100 rpcz_store.cc:269] 0503 07:58:38.435896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.436023 (+ 127us) service_pool.cc:224] Handling call
0503 07:58:40.531973 (+2095950us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b54002c97d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:40.534630 (+ 2657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147707648}
I20260503 07:58:40.537030 28102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43228 (request call id 1745) took 2064 ms. Trace:
I20260503 07:58:40.547963 28102 rpcz_store.cc:276] 0503 07:58:38.472742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.472847 (+ 105us) service_pool.cc:224] Handling call
0503 07:58:38.481294 (+ 8447us) raft_consensus.cc:1471] Updating replica for 1 ops
0503 07:58:38.499331 (+ 18037us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:38.499355 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0503 07:58:38.499772 (+ 417us) log.cc:844] Serialized 26 byte log entry
0503 07:58:40.043275 (+1543503us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:40.043327 (+ 52us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.536432 (+493105us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b540004a1d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:40.536504 (+ 72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:40.536566 (+ 62us) raft_consensus.cc:1685] finished
0503 07:58:40.536579 (+ 13us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.536841 (+ 262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1395,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1903,"spinlock_wait_cycles":40595840,"thread_start_us":1543182,"threads_started":1,"wal-append.queue_time_us":1728226}
I20260503 07:58:40.550846 30829 leader_election.cc:290] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.552958 31067 leader_election.cc:290] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.546007 28104 rpcz_store.cc:276] 0503 07:58:38.455711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.455811 (+ 100us) service_pool.cc:224] Handling call
0503 07:58:38.456057 (+ 246us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:38.514650 (+ 58593us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.538573 (+2023923us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b540037b9d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:40.538848 (+ 275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115849600}
I20260503 07:58:40.562004 30826 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:40.562398 30826 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:40.562728 30826 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:40.559854 27857 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 6, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:40.570479 30694 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:40.570971 30694 raft_consensus.cc:493] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:40.576496 30694 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:40.578091 27960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45176 (request call id 1745) took 1008 ms. Trace:
I20260503 07:58:40.578508 27960 rpcz_store.cc:276] 0503 07:58:39.569903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:39.570011 (+ 108us) service_pool.cc:224] Handling call
0503 07:58:39.570305 (+ 294us) raft_consensus.cc:1471] Updating replica for 0 ops
0503 07:58:39.570485 (+ 180us) raft_consensus.cc:1534] Early marking committed up to index 7
0503 07:58:40.155328 (+584843us) log.cc:844] Serialized 14 byte log entry
0503 07:58:40.577372 (+422044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0503 07:58:40.577480 (+ 108us) raft_consensus.cc:1645] Marking committed up to 7
0503 07:58:40.577600 (+ 120us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.577709 (+ 109us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.577880 (+ 171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":675483,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":238,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":131,"thread_start_us":991431,"threads_started":2}
I20260503 07:58:40.600939 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.601820 28101 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
I20260503 07:58:40.573465 27958 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:40.545670 31038 raft_consensus.cc:493] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:40.566525 27857 catalog_manager.cc:5671] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 6, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:40.628722 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.632933 28101 raft_consensus.cc:2393] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 7: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:40.634467 31020 consensus_queue.cc:1059] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:40.629746 31038 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:40.635389 31020 raft_consensus.cc:3055] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:40.646405 28073 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:40.647122 27855 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 316) took 7417 ms. Trace:
I20260503 07:58:40.678021 27855 rpcz_store.cc:276] 0503 07:58:33.229147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:33.229336 (+ 189us) service_pool.cc:224] Handling call
0503 07:58:40.646918 (+7417582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:36.096839 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:36.113604 (+ 16765us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:36.113634 (+ 30us) write_op.cc:435] Acquired schema lock
0503 07:58:36.113647 (+ 13us) tablet.cc:662] Decoding operations
0503 07:58:36.114291 (+ 644us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:36.114373 (+ 82us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:36.114417 (+ 44us) tablet.cc:685] Acquiring locks for 3 operations
0503 07:58:36.114835 (+ 418us) tablet.cc:701] Row locks acquired
0503 07:58:36.114854 (+ 19us) write_op.cc:260] PREPARE: finished
0503 07:58:36.115013 (+ 159us) write_op.cc:270] Start()
0503 07:58:36.115144 (+ 131us) write_op.cc:276] Timestamp: P: 1777795116114961 usec, L: 0
0503 07:58:36.115164 (+ 20us) op_driver.cc:348] REPLICATION: starting
0503 07:58:36.115824 (+ 660us) log.cc:844] Serialized 1294 byte log entry
0503 07:58:38.427196 (+2311372us) op_driver.cc:464] REPLICATION: finished
0503 07:58:38.444767 (+ 17571us) write_op.cc:301] APPLY: starting
0503 07:58:38.445412 (+ 645us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:38.459423 (+ 14011us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:38.472486 (+ 13063us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:38.515228 (+ 42742us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:38.530883 (+ 15655us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0503 07:58:38.544877 (+ 13994us) write_op.cc:312] APPLY: finished
0503 07:58:38.591908 (+ 47031us) log.cc:844] Serialized 35 byte log entry
0503 07:58:38.617471 (+ 25563us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:38.623289 (+ 5818us) write_op.cc:454] Released schema lock
0503 07:58:38.628075 (+ 4786us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:38.717204 (+ 89129us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:38.723795 (+ 6591us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2905095,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":2746,"apply.run_cpu_time_us":2624,"apply.run_wall_time_us":228670,"num_ops":3,"prepare.queue_time_us":566540,"prepare.run_cpu_time_us":3124,"prepare.run_wall_time_us":21600,"replication_time_us":2301598}]]}
I20260503 07:58:40.652662 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.653524 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:40.657158 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 411735us
I20260503 07:58:40.683094 30956 raft_consensus.cc:515] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.685403 28583 leader_election.cc:304] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:40.661512 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.686496 30842 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:40.662926 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.686937 28583 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:40.666618 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.688330 28107 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:40.688444 30956 leader_election.cc:290] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.667508 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:40.689342 28619 raft_consensus.cc:2393] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 7: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:40.689483 28108 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 9
I20260503 07:58:40.689731 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:40.668437 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.647076 31020 raft_consensus.cc:740] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:40.681712 31067 raft_consensus.cc:2749] T d9cb650978e344c697c44de57e4393e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:40.683012 28073 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:40.689224 31065 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:40.640221 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.672034 31005 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:40.690392 28619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51178 (request call id 285) took 1863 ms (client timeout 1889 ms). Trace:
I20260503 07:58:40.694816 28104 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:40.697993 28032 raft_consensus.cc:2393] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
W20260503 07:58:40.696578 28619 rpcz_store.cc:269] 0503 07:58:38.827181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:38.827337 (+ 156us) service_pool.cc:224] Handling call
0503 07:58:40.467355 (+1640018us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800024998. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f85014c4941 00007f85016496c1 00007f8501649572 00007f850a5061d9 00007f85096815e0 00007f850974a76b 00007f850974a7f1 00007f85096f8760 00007f85096f8044 00007f8502c65834 00007f8502c657c2
0503 07:58:40.690186 (+222831us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54003e5b54. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047286da 00007f85096f81d7 00007f8502c65834 00007f8502c657c2 00007f8502c656f1 00007f8502c6566c 00007f8502c64922 00007f8502a5ebcc 00007f8502a5e006 00007f8502a5d9af
0503 07:58:40.690325 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397400704}
I20260503 07:58:40.696334 31065 raft_consensus.cc:493] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:40.700663 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:40.694232 30826 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.701392 31020 consensus_queue.cc:260] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:40.706061 30377 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:40.710944 30377 raft_consensus.cc:493] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:40.711346 30377 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:40.713711 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.713918 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:40.714459 27958 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 5.
I20260503 07:58:40.714745 28028 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:40.716065 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77488bc798a841d697b108fb23d5531b" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.708748 31065 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:40.718295 31005 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.719060 28031 raft_consensus.cc:1240] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:40.721364 31020 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:40.721508 31066 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:40.721947 31066 raft_consensus.cc:493] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:40.722368 31066 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:40.722472 30694 raft_consensus.cc:515] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.725822 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:40.708271 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:40.726490 28031 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:40.726962 30993 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:40.727416 30993 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:40.727814 30993 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:40.710048 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.729593 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.729825 30769 consensus_queue.cc:1048] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260503 07:58:40.733377 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.735656 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
W20260503 07:58:40.737411 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 54559us
I20260503 07:58:40.737818 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.738777 31067 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:40.740124 30826 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.741509 28109 raft_consensus.cc:1240] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:40.742821 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.742916 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:40.745929 28108 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 9.
I20260503 07:58:40.752779 30993 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.696743 31010 raft_consensus.cc:515] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.754719 30993 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:40.755940 31010 leader_election.cc:290] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.755811 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:40.768477 28035 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:40.770247 28029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33294 (request call id 2172) took 4025 ms. Trace:
I20260503 07:58:40.770550 28029 rpcz_store.cc:276] 0503 07:58:36.745070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.745245 (+ 175us) service_pool.cc:224] Handling call
0503 07:58:36.745507 (+ 262us) raft_consensus.cc:1471] Updating replica for 2 ops
0503 07:58:36.926068 (+180561us) raft_consensus.cc:1534] Early marking committed up to index 0
0503 07:58:36.926110 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0503 07:58:40.249421 (+3323311us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b2c00006d78. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850301ec81 00007f850302e5e2 00007f850475fde1 00007f850472481a 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22
0503 07:58:40.269328 (+ 19907us) log.cc:844] Serialized 52 byte log entry
0503 07:58:40.609366 (+340038us) raft_consensus.cc:1645] Marking committed up to 4
0503 07:58:40.691649 (+ 82283us) log.cc:844] Serialized 14 byte log entry
0503 07:58:40.697255 (+ 5606us) raft_consensus.cc:1697] Filling consensus response to leader.
0503 07:58:40.769868 (+ 72613us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54002814d4. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f85047251e1 00007f8504723c1e 00007f85096f6ad9 00007f8502c60d34 00007f8502c60cc2 00007f8502c60bf1 00007f8502c60b6c 00007f8502c5fe22 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:40.769907 (+ 39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0503 07:58:40.769959 (+ 52us) raft_consensus.cc:1685] finished
0503 07:58:40.769971 (+ 12us) raft_consensus.cc:1691] UpdateReplicas() finished
0503 07:58:40.770107 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9729,"prepare.queue_time_us":29355,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":10710,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":74707,"spinlock_wait_cycles":1081233408,"thread_start_us":249490,"threads_started":2,"wal-append.queue_time_us":247624}
I20260503 07:58:40.777376 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.777999 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.778560 27954 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:40.746447 30956 consensus_queue.cc:1059] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260503 07:58:40.801661 28035 raft_consensus.cc:2468] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:40.799121 31065 raft_consensus.cc:515] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.805837 30956 raft_consensus.cc:3055] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:40.806207 30956 raft_consensus.cc:740] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:40.807050 30956 consensus_queue.cc:260] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.811455 31066 raft_consensus.cc:515] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:40.811973 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:40.814101 28619 raft_consensus.cc:2393] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 7: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:40.815110 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.748275 30694 leader_election.cc:290] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.820508 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e3ed8ebbe4d968d5ab9e678ea1561" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.823724 28031 raft_consensus.cc:2410] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25017111886b42cfa5701a39de59b6ad for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260503 07:58:40.829263 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:40.834190 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:40.834892 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.835592 28618 raft_consensus.cc:2393] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate 25017111886b42cfa5701a39de59b6ad in this term.
I20260503 07:58:40.836473 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.836880 28621 raft_consensus.cc:1240] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:40.837316 27952 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 11.
I20260503 07:58:40.730851 31038 raft_consensus.cc:515] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.839097 28028 raft_consensus.cc:2468] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:40.836934 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.841372 28585 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:40.842628 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.815044 31065 leader_election.cc:290] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:40.846264 27959 raft_consensus.cc:3060] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:40.846612 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.846303 31010 raft_consensus.cc:2804] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election won for term 6
W20260503 07:58:40.851459 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 46332.2us
I20260503 07:58:40.853673 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:40.852313 28585 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:40.856063 31010 raft_consensus.cc:697] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:40.856850 31066 leader_election.cc:290] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.854998 28073 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:40.858880 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.853145 30956 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:40.859686 28107 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:40.864802 27924 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:40.855212 30901 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:40.867537 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.867084 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.872265 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.860832 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.874630 27952 raft_consensus.cc:2368] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:40.877501 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.878494 30901 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.863232 31010 consensus_queue.cc:237] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:40.869199 30993 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:40.880854 30901 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:40.900087 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 45148.1us
I20260503 07:58:40.897620 27959 raft_consensus.cc:2468] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 10.
I20260503 07:58:40.887787 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:40.908396 27954 raft_consensus.cc:1275] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:40.911870 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.912545 27952 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:40.911244 28583 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:40.919930 27956 raft_consensus.cc:1240] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 5. Current term is 6. Ops: []
W20260503 07:58:40.923430 27999 connection.cc:254] RPC call timeout handler was delayed by -1.8094877400001224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
I20260503 07:58:40.927932 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.923329 31069 raft_consensus.cc:2804] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:40.930294 31066 consensus_queue.cc:1059] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:40.930562 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.930693 31069 raft_consensus.cc:697] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [term 10 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:40.931303 27951 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:40.930855 30863 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260503 07:58:40.930435 31013 raft_consensus.cc:2804] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:40.937219 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.949474 27924 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:40.949618 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.952443 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:40.974792 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.975926 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
W20260503 07:58:40.977630 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 50306.1us
I20260503 07:58:40.950701 31013 raft_consensus.cc:697] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:40.981841 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:40.970209 31038 leader_election.cc:290] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:40.991235 28031 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:40.971884 30983 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:40.991654 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:40.992323 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.009230 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.008723 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.032435 27954 raft_consensus.cc:2368] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:41.031697 27956 raft_consensus.cc:2468] T 48cbd9f468974e1db163ad369f5d7d11 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:41.035843 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.040094 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.052083 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.053673 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.055331 28107 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 12.
I20260503 07:58:41.056711 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:41.081851 31088 log.cc:927] Time spent T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad: Append to log took a long time: real 0.110s user 0.000s sys 0.001s
W20260503 07:58:41.083648 31089 log.cc:927] Time spent T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.152s user 0.000s sys 0.000s
I20260503 07:58:41.004614 30990 consensus_queue.cc:1059] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260503 07:58:41.084664 30769 raft_consensus.cc:3055] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:41.084995 30769 raft_consensus.cc:740] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:41.085808 30769 consensus_queue.cc:260] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.089520 31065 raft_consensus.cc:3055] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:41.089908 31065 raft_consensus.cc:740] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:41.034126 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eec1cba8286a4c81a9f66d33c805d337" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:41.090734 31065 consensus_queue.cc:260] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.100117 30557 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:41.101527 28031 raft_consensus.cc:2468] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 6.
I20260503 07:58:41.101141 30377 raft_consensus.cc:515] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.102582 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.103257 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.106683 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.106882 31013 consensus_queue.cc:237] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.108258 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.087265 30769 raft_consensus.cc:3060] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:41.120844 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.126284 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.126922 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.127993 27957 raft_consensus.cc:2468] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:41.128804 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.129944 28109 raft_consensus.cc:1240] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:41.131453 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.131692 27957 raft_consensus.cc:2468] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 11.
I20260503 07:58:41.049870 30983 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:41.131446 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 209048us
I20260503 07:58:41.133649 27960 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 4.
I20260503 07:58:40.993041 31069 consensus_queue.cc:237] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.141520 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:41.143534 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 188262us
I20260503 07:58:41.143777 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:41.144898 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4295725240000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2666s for a response
I20260503 07:58:41.145138 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:41.145411 27999 connection.cc:254] RPC call timeout handler was delayed by -1.4295725240000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2666s for a response
I20260503 07:58:41.145777 27956 raft_consensus.cc:2468] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
W20260503 07:58:41.145895 27999 connection.cc:254] RPC call timeout handler was delayed by -1.0786531090000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26680000000000004s for a response
I20260503 07:58:41.147121 27999 leader_election.cc:304] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:41.147133 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:41.148286 30825 raft_consensus.cc:2764] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260503 07:58:41.153616 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.156209 27956 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 in current term 9: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:41.164958 27959 raft_consensus.cc:2468] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:41.164921 28585 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:41.166931 28583 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.164311 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:41.168388 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.164770 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.176442 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.125073 30557 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:41.182857 31065 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:41.184460 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:41.185142 30862 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260503 07:58:41.185408 31070 consensus_queue.cc:1059] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260503 07:58:41.186436 28615 raft_consensus.cc:1240] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:41.187139 27959 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260503 07:58:41.187988 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.188784 30983 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:41.189939 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:41.191287 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.193014 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:41.194049 27959 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Advancing to term 12
I20260503 07:58:41.202782 31095 raft_consensus.cc:2804] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election won for term 6
W20260503 07:58:41.203495 31087 log.cc:927] Time spent T c3757a05a49e489386cdbf85d2f8e970 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
W20260503 07:58:41.202667 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 46470.4us
I20260503 07:58:41.206418 31070 raft_consensus.cc:3055] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:41.206774 31070 raft_consensus.cc:740] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:41.207604 31070 consensus_queue.cc:260] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.203528 31095 raft_consensus.cc:697] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:41.210251 31095 consensus_queue.cc:237] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.208776 31070 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:41.174096 30842 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:41.226277 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 77215.7us
I20260503 07:58:41.233783 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.172760 31005 raft_consensus.cc:493] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:41.234424 27960 raft_consensus.cc:2468] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:41.240923 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.238519 27954 raft_consensus.cc:2468] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:41.243376 27959 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 12.
I20260503 07:58:41.252743 27951 raft_consensus.cc:2468] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:41.255867 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.260778 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.261577 28109 raft_consensus.cc:2393] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 6: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:41.245126 30983 raft_consensus.cc:493] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:41.257194 31059 raft_consensus.cc:2749] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 07:58:41.275249 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:41.280220 27952 raft_consensus.cc:2468] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 9.
I20260503 07:58:41.261883 31005 raft_consensus.cc:515] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.287039 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.296489 28583 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:41.273120 30377 leader_election.cc:290] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:41.298434 28583 leader_election.cc:304] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:41.302019 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.315622 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.337811 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.304001 31094 raft_consensus.cc:2804] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:41.304226 31066 raft_consensus.cc:2804] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:41.293350 30983 raft_consensus.cc:515] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.350672 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.352684 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.348527 31094 raft_consensus.cc:697] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:41.350880 31066 raft_consensus.cc:697] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 9 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:41.363108 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.364248 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.364934 28031 raft_consensus.cc:2393] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:41.362852 28616 raft_consensus.cc:1240] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:41.367039 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.368221 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.368418 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.368914 28103 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:41.368916 28028 raft_consensus.cc:2368] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:41.370698 28100 raft_consensus.cc:2468] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 10.
I20260503 07:58:41.362000 30557 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525)
I20260503 07:58:41.376874 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.377548 28103 raft_consensus.cc:2393] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 7: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:41.389947 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.389685 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:41.390779 28103 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:41.392297 28028 raft_consensus.cc:1240] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:41.393543 31094 consensus_queue.cc:237] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.395581 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.398867 28028 raft_consensus.cc:2393] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:41.398622 31066 consensus_queue.cc:237] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.403330 27958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:41.403849 27958 raft_consensus.cc:606] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.404196 27958 raft_consensus.cc:614] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:41.410745 30842 raft_consensus.cc:2749] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:41.411948 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:41.412500 28107 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 8
I20260503 07:58:41.413396 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.413676 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.414016 28031 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:41.414377 28032 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:41.415284 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:41.415519 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.415796 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.416145 28033 raft_consensus.cc:2468] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 13.
I20260503 07:58:41.416379 28027 raft_consensus.cc:2468] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:41.416628 28101 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260503 07:58:41.416900 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.417135 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.417330 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.417531 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.417948 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.418083 28032 raft_consensus.cc:2468] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:41.419014 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.418095 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.420150 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.420451 28027 raft_consensus.cc:2468] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:41.420845 28031 raft_consensus.cc:2393] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:41.426535 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.427351 28028 raft_consensus.cc:2468] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 8.
I20260503 07:58:41.425987 28107 raft_consensus.cc:2468] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:41.431548 31005 leader_election.cc:290] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:41.418004 28034 raft_consensus.cc:2468] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:41.441378 30983 leader_election.cc:290] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:41.442708 31101 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.139s user 0.003s sys 0.000s
I20260503 07:58:41.444892 27958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:41.445452 27958 raft_consensus.cc:606] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:41.448182 27958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:41.448706 27958 raft_consensus.cc:606] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:41.449051 27958 raft_consensus.cc:614] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:41.451395 27958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:41.451925 27958 raft_consensus.cc:606] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:41.453297 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:41.456271 28108 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:41.457633 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:41.458817 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:41.462437 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.463068 28108 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 3.
I20260503 07:58:41.463308 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:41.463887 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816629c788364a77be087fd62784f4de" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:41.464576 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "971ac26c5f9841959a1801eb548b0ff0" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:41.465394 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a813d887a574b1f8a8be222ff2c07ae" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:41.469655 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.485991 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:41.486542 28034 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:41.489300 28027 raft_consensus.cc:1275] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260503 07:58:41.490629 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.491286 28035 raft_consensus.cc:2468] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 11.
I20260503 07:58:41.502058 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.502727 28035 raft_consensus.cc:2468] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:41.510062 28035 raft_consensus.cc:1240] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:41.518862 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.519444 28027 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:41.521369 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.521966 28026 raft_consensus.cc:2468] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:41.523275 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.523976 28027 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:41.525980 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.526610 28026 raft_consensus.cc:2468] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:41.528476 28026 raft_consensus.cc:1240] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:41.529569 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.530550 28027 raft_consensus.cc:2468] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
W20260503 07:58:41.533836 31107 log.cc:927] Time spent T 00000000000000000000000000000000 P 07b43b33af274daa91d071dedcd4ed8b: Append to log took a long time: real 0.138s user 0.001s sys 0.000s
W20260503 07:58:41.536731 31108 log.cc:927] Time spent T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260503 07:58:41.550977 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.552462 28035 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:41.554463 28613 raft_consensus.cc:2468] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:41.560786 28034 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7.
I20260503 07:58:41.572186 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:41.573313 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:41.582091 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:41.583511 28034 raft_consensus.cc:2393] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
W20260503 07:58:41.581278 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 113485us
I20260503 07:58:41.605283 27999 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.606395 30862 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:41.607048 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:41.608014 30862 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:41.608512 30862 raft_consensus.cc:493] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:41.609048 30862 raft_consensus.cc:3060] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:41.609627 28615 raft_consensus.cc:1240] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:41.616663 28034 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260503 07:58:41.616873 28035 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260503 07:58:41.616963 28034 pending_rounds.cc:85] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 7
I20260503 07:58:41.617458 28034 pending_rounds.cc:107] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260503 07:58:41.617715 28034 raft_consensus.cc:2889] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:41.574239 31094 consensus_queue.cc:1059] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260503 07:58:41.618528 31094 raft_consensus.cc:3055] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:41.618829 31094 raft_consensus.cc:740] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:41.619514 31094 consensus_queue.cc:260] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.620704 31094 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:41.593900 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9196b781b73d42de863558f5a560cce2" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:41.608814 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.630285 31066 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260503 07:58:41.641230 27924 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.638226 31005 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260503 07:58:41.654471 31110 log.cc:927] Time spent T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473: Append to log took a long time: real 0.071s user 0.001s sys 0.000s
I20260503 07:58:41.635313 31013 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260503 07:58:41.647223 30983 raft_consensus.cc:3060] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:41.656440 27924 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:41.657281 27924 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:41.658058 27924 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.657946 30862 raft_consensus.cc:515] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.659853 30862 leader_election.cc:290] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:41.663980 30769 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:41.664341 30769 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:41.664650 30769 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Advancing to term 11
W20260503 07:58:41.673220 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 64576.1us
I20260503 07:58:41.673969 27999 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.663558 31059 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:41.678267 31059 raft_consensus.cc:493] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:41.678670 31059 raft_consensus.cc:3060] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:41.684041 28073 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:41.686657 27951 raft_consensus.cc:1275] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260503 07:58:41.693565 30862 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:41.694468 30557 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:41.694823 30557 raft_consensus.cc:493] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:41.695168 30557 raft_consensus.cc:3060] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
W20260503 07:58:41.695411 28584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:41.697549 30842 consensus_queue.cc:1048] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:41.698375 28031 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:41.705003 27999 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:41.706612 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 48610.1us
I20260503 07:58:41.714537 31005 raft_consensus.cc:2749] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:41.742372 31126 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:41.743407 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 65833.3us
I20260503 07:58:41.714457 30842 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260503 07:58:41.758097 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 50653.7us
W20260503 07:58:41.758445 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 111494us
I20260503 07:58:41.765280 28073 leader_election.cc:304] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:41.770047 27960 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260503 07:58:41.773420 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 68559.8us
I20260503 07:58:41.773486 30863 raft_consensus.cc:2749] T 77488bc798a841d697b108fb23d5531b P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:41.774006 28073 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:41.763847 27855 catalog_manager.cc:5671] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:41.781265 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.781378 27857 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33434 (request call id 326) took 7419 ms. Trace:
I20260503 07:58:41.781826 28073 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:41.782433 28028 raft_consensus.cc:1275] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260503 07:58:41.778241 30863 raft_consensus.cc:2804] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:41.782711 28073 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:41.783238 30863 raft_consensus.cc:493] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:41.783466 30845 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260503 07:58:41.783691 30863 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:41.783886 30845 raft_consensus.cc:493] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader adaf84b6ac60420ab03d39b9db9f0413)
I20260503 07:58:41.784291 30845 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:41.784898 30377 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:41.786878 28073 leader_election.cc:400] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:41.787345 28073 leader_election.cc:403] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:41.782015 27857 rpcz_store.cc:276] 0503 07:58:34.362226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:34.362408 (+ 182us) service_pool.cc:224] Handling call
0503 07:58:41.781327 (+7418919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:40.881193 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:40.921050 (+ 39857us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:40.931764 (+ 10714us) write_op.cc:435] Acquired schema lock
0503 07:58:40.933952 (+ 2188us) tablet.cc:662] Decoding operations
0503 07:58:41.031271 (+ 97319us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:41.036293 (+ 5022us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:41.041607 (+ 5314us) tablet.cc:685] Acquiring locks for 2 operations
0503 07:58:41.178911 (+137304us) tablet.cc:701] Row locks acquired
0503 07:58:41.178926 (+ 15us) write_op.cc:260] PREPARE: finished
0503 07:58:41.225412 (+ 46486us) write_op.cc:270] Start()
0503 07:58:41.225522 (+ 110us) write_op.cc:276] Timestamp: P: 1777795121225354 usec, L: 0
0503 07:58:41.225549 (+ 27us) op_driver.cc:348] REPLICATION: starting
0503 07:58:41.255460 (+ 29911us) log.cc:844] Serialized 912 byte log entry
0503 07:58:41.671165 (+415705us) op_driver.cc:464] REPLICATION: finished
0503 07:58:41.722554 (+ 51389us) write_op.cc:301] APPLY: starting
0503 07:58:41.722655 (+ 101us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:41.722781 (+ 126us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:41.722924 (+ 143us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:41.723990 (+ 1066us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:41.724265 (+ 275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0503 07:58:41.724317 (+ 52us) write_op.cc:312] APPLY: finished
0503 07:58:41.724563 (+ 246us) log.cc:844] Serialized 29 byte log entry
0503 07:58:41.740975 (+ 16412us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:41.744630 (+ 3655us) write_op.cc:454] Released schema lock
0503 07:58:41.749244 (+ 4614us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:41.749772 (+ 528us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:41.749808 (+ 36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":828801,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":51104,"apply.run_cpu_time_us":2286,"apply.run_wall_time_us":27176,"num_ops":2,"prepare.queue_time_us":190223,"prepare.run_cpu_time_us":23008,"prepare.run_wall_time_us":498659,"raft.queue_time_us":135136,"raft.run_cpu_time_us":13687,"raft.run_wall_time_us":52579,"replication_time_us":445467,"thread_start_us":247694,"threads_started":4,"wal-append.queue_time_us":105052}]]}
I20260503 07:58:41.789363 30862 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:41.789346 31059 raft_consensus.cc:515] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.791540 31059 leader_election.cc:290] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:41.791610 27999 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.793929 31020 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9.
I20260503 07:58:41.794658 30983 raft_consensus.cc:2749] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:41.797091 30862 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:41.782666 31066 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260503 07:58:41.779594 27855 catalog_manager.cc:5671] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 6 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:41.799147 27924 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:41.799304 30983 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:41.800244 31127 raft_consensus.cc:2804] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:41.799175 27855 catalog_manager.cc:5671] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 5 to 6, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 6 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:41.760774 30557 raft_consensus.cc:515] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:41.809146 28073 leader_election.cc:400] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:41.809538 28073 leader_election.cc:403] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260503 07:58:41.806344 31020 consensus_queue.cc:1048] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260503 07:58:41.813472 28616 raft_consensus.cc:2468] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 6.
I20260503 07:58:41.801720 31070 consensus_queue.cc:1048] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260503 07:58:41.806993 27855 catalog_manager.cc:5671] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 6 to 7, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 7 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:41.816968 27855 catalog_manager.cc:5671] T d9cb650978e344c697c44de57e4393e6 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 5 to 7, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:41.826494 30769 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.821084 27855 catalog_manager.cc:5671] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:41.830417 27999 leader_election.cc:304] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:41.830677 27855 catalog_manager.cc:5671] T 3d2e3ed8ebbe4d968d5ab9e678ea1561 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 8 to 10, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 10 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:41.835233 27855 catalog_manager.cc:5671] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 7 to 9, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to 25017111886b42cfa5701a39de59b6ad (127.26.42.4). New cstate: current_term: 9 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:41.828243 30769 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:41.831553 31020 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525) with higher term. Message: Invalid argument: T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:41.837102 30862 raft_consensus.cc:2749] T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:41.818074 31131 consensus_queue.cc:1059] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260503 07:58:41.857689 30557 leader_election.cc:290] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
W20260503 07:58:41.900051 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 79217.4us
I20260503 07:58:41.853852 31127 raft_consensus.cc:697] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:41.921463 27960 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260503 07:58:41.941504 27999 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:41.942781 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 87901.4us
I20260503 07:58:41.912218 30863 raft_consensus.cc:515] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.909422 30845 raft_consensus.cc:515] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.933516 30842 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260503 07:58:41.967079 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.967818 30862 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260503 07:58:41.968216 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.969091 30862 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:41.957088 31005 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:41.942377 31127 consensus_queue.cc:237] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.986937 31133 raft_consensus.cc:3055] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:41.987291 31133 raft_consensus.cc:740] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:41.988008 31133 consensus_queue.cc:260] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:41.992817 30845 leader_election.cc:290] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:41.992967 27999 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:41.993661 31005 raft_consensus.cc:2749] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:41.994843 31005 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260503 07:58:41.996423 27999 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:41.996632 31135 log.cc:927] Time spent T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.063s user 0.003s sys 0.000s
I20260503 07:58:41.997308 31133 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:41.997939 30862 raft_consensus.cc:2749] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260503 07:58:41.998602 30863 leader_election.cc:290] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
W20260503 07:58:42.021420 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.022212 31126 raft_consensus.cc:2749] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 07:58:42.037575 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 90327.2us
W20260503 07:58:42.040335 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 43997.7us
W20260503 07:58:42.041062 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 210672us
I20260503 07:58:42.042471 27924 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:42.045174 31059 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:42.045565 31059 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:42.045944 31059 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:42.048127 31143 consensus_queue.cc:1059] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260503 07:58:42.049561 30377 raft_consensus.cc:3055] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:42.049961 30377 raft_consensus.cc:740] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:42.050810 30377 consensus_queue.cc:260] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:42.051652 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 128822us
I20260503 07:58:42.052287 31059 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.052743 30377 raft_consensus.cc:3060] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:42.054355 31059 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:42.058480 31143 consensus_queue.cc:1059] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260503 07:58:42.059329 31143 consensus_queue.cc:1243] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer 25017111886b42cfa5701a39de59b6ad log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260503 07:58:42.059672 30845 raft_consensus.cc:3055] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:42.059980 30845 raft_consensus.cc:740] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:42.060678 27958 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260503 07:58:42.060745 30845 consensus_queue.cc:260] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.062496 30845 raft_consensus.cc:3060] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:42.069235 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:42.070591 27924 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:42.073236 31059 raft_consensus.cc:2804] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:42.074127 31059 raft_consensus.cc:697] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [term 6 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:42.075506 31143 consensus_queue.cc:1059] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:42.076390 30557 raft_consensus.cc:3055] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:42.076545 31069 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260503 07:58:42.076771 28073 leader_election.cc:304] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:42.076800 30557 raft_consensus.cc:740] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:42.078855 30557 consensus_queue.cc:260] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.080775 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:42.089370 28031 raft_consensus.cc:3055] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:42.089738 28031 raft_consensus.cc:740] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
W20260503 07:58:42.089978 31147 log.cc:927] Time spent T c2b5d5b5c52e455ca768d69be2c3e744 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.124s user 0.001s sys 0.000s
I20260503 07:58:42.090411 28031 consensus_queue.cc:260] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.090440 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.081485 31143 raft_consensus.cc:2804] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:42.093856 28031 raft_consensus.cc:3060] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:42.105762 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.106482 27954 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:42.107224 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
W20260503 07:58:42.110199 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.085081 31153 raft_consensus.cc:2804] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:42.075328 31059 consensus_queue.cc:237] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.100517 30557 raft_consensus.cc:3060] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
W20260503 07:58:42.114699 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:42.119158 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 78248.6us
I20260503 07:58:42.119809 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:42.111946 31153 raft_consensus.cc:493] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:42.114351 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:42.116082 31143 raft_consensus.cc:697] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:42.134145 30862 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:42.157234 28109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.157827 28109 raft_consensus.cc:2393] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 11: Already voted for candidate be26cebb7c90445ea9a74f66463457c1 in this term.
I20260503 07:58:42.163554 28616 raft_consensus.cc:2393] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
W20260503 07:58:42.165488 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 45743.6us
I20260503 07:58:42.154309 28031 raft_consensus.cc:1275] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260503 07:58:42.166738 28031 pending_rounds.cc:85] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 8
I20260503 07:58:42.166996 28031 pending_rounds.cc:107] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260503 07:58:42.167241 28031 raft_consensus.cc:2889] T 28731014d42b4316af0150b0e98f6152 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:42.129006 31153 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:42.170439 27954 raft_consensus.cc:2468] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 12.
I20260503 07:58:42.171953 27999 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:42.175453 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.177824 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
W20260503 07:58:42.178860 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.184289 28108 raft_consensus.cc:3055] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:42.184728 28108 raft_consensus.cc:740] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:42.185753 28105 raft_consensus.cc:1275] T 971ac26c5f9841959a1801eb548b0ff0 P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:42.185444 28108 consensus_queue.cc:260] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.186452 28107 raft_consensus.cc:1275] T 8a813d887a574b1f8a8be222ff2c07ae P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260503 07:58:42.190521 30862 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:42.190840 28100 raft_consensus.cc:2468] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:42.214360 28073 leader_election.cc:304] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
W20260503 07:58:42.214887 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 48780.7us
I20260503 07:58:42.215369 27955 raft_consensus.cc:1240] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 3. Current term is 4. Ops: []
I20260503 07:58:42.216185 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:42.218595 31154 raft_consensus.cc:2749] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:42.218869 30862 raft_consensus.cc:2804] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:42.219365 30862 raft_consensus.cc:493] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:42.219780 30862 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:42.219836 28073 leader_election.cc:304] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:42.229487 27924 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:42.231879 31143 consensus_queue.cc:237] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.233961 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:42.237169 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:42.229769 31069 consensus_queue.cc:1048] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260503 07:58:42.233325 31154 raft_consensus.cc:2804] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Leader election won for term 12
I20260503 07:58:42.242349 31005 raft_consensus.cc:2804] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260503 07:58:42.249756 31005 raft_consensus.cc:493] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:42.250213 31005 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:42.253141 31148 consensus_queue.cc:1059] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260503 07:58:42.256246 27959 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:42.236198 31133 raft_consensus.cc:2749] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260503 07:58:42.278115 31168 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260503 07:58:42.278537 31168 raft_consensus.cc:493] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:42.278903 31168 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:42.255992 31094 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260503 07:58:42.293478 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 56437.3us
I20260503 07:58:42.305684 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:42.280321 31154 raft_consensus.cc:697] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 12 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:42.307250 27924 leader_election.cc:304] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:42.308094 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 50676.3us
I20260503 07:58:42.315531 31005 raft_consensus.cc:515] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.320261 31154 consensus_queue.cc:237] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.334232 30983 raft_consensus.cc:2804] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:42.343518 31070 consensus_queue.cc:1048] T 971ac26c5f9841959a1801eb548b0ff0 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:42.344578 31005 leader_election.cc:290] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:42.350344 30842 consensus_queue.cc:1048] T 8a813d887a574b1f8a8be222ff2c07ae P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260503 07:58:42.303666 31094 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.358014 31010 raft_consensus.cc:3055] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Stepping down as leader of term 3
I20260503 07:58:42.358325 31094 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:42.346534 31020 consensus_queue.cc:1059] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260503 07:58:42.359489 28108 raft_consensus.cc:3060] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:42.359607 31005 raft_consensus.cc:2804] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:42.359969 31005 raft_consensus.cc:493] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:42.360260 31005 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:42.366482 30862 raft_consensus.cc:515] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.368187 30862 leader_election.cc:290] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:42.358335 31010 raft_consensus.cc:740] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:42.370177 31010 consensus_queue.cc:260] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.369115 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.373961 28035 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 8.
I20260503 07:58:42.383005 28616 raft_consensus.cc:1240] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:42.383381 31010 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:42.384061 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:42.381378 28585 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
W20260503 07:58:42.385212 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 79655.1us
I20260503 07:58:42.386232 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:42.437737 28105 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
W20260503 07:58:42.449566 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 63396.6us
I20260503 07:58:42.451949 28108 raft_consensus.cc:1275] T 816629c788364a77be087fd62784f4de P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260503 07:58:42.385864 30983 raft_consensus.cc:697] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:42.401445 30842 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:42.372311 31153 raft_consensus.cc:515] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.461598 31164 consensus_queue.cc:1048] T 816629c788364a77be087fd62784f4de P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:42.463557 27854 catalog_manager.cc:5671] T fa70a5c46ac143db96b5fa56b70d4170 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 9 to 10, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 10 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:42.465554 31172 raft_consensus.cc:2804] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:42.466146 31172 raft_consensus.cc:493] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:42.466485 31172 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:42.466760 31005 raft_consensus.cc:515] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.466710 27854 catalog_manager.cc:5671] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 8 to 10, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 10 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:42.468502 31005 leader_election.cc:290] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:42.469305 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.468454 27854 catalog_manager.cc:5671] T a77e35309a36413d8eaa064760e0e7ba P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.475409 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:42.469215 30842 raft_consensus.cc:493] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260503 07:58:42.470247 31162 log.cc:927] Time spent T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260503 07:58:42.484457 28108 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:42.479709 30842 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:42.481281 31005 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260503 07:58:42.497989 31153 leader_election.cc:290] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:42.491286 30983 consensus_queue.cc:237] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:42.493114 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.511430 31168 raft_consensus.cc:515] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.513295 31168 leader_election.cc:290] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:42.513872 28034 raft_consensus.cc:1240] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 4. Current term is 5. Ops: []
I20260503 07:58:42.504077 31175 raft_consensus.cc:2804] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:42.515936 31175 raft_consensus.cc:493] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:42.516336 31175 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:42.509825 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:42.515964 31013 consensus_queue.cc:1059] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260503 07:58:42.534232 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 47871us
W20260503 07:58:42.540805 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.538982 31176 raft_consensus.cc:2804] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:42.544999 27999 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:42.546052 27854 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33446 (request call id 321) took 6972 ms. Trace:
I20260503 07:58:42.550755 31153 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Leader election won for term 12
I20260503 07:58:42.551221 31153 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 12 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:42.551996 31153 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.547158 27854 rpcz_store.cc:276] 0503 07:58:35.573604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:35.573730 (+ 126us) service_pool.cc:224] Handling call
0503 07:58:36.371027 (+797297us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400041354. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468e470 00007f850472d31a 00007f850a4d046c 00007f850a5ca3ee 00007f8508ab04a4 00007f8508ab0432 00007f8508ab0361 00007f8508ab02dc 00007f8508aaf592 00007f8502a5ebcc 00007f8502a5e006
0503 07:58:42.545985 (+6174958us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:42.514185 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:42.514662 (+ 477us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:42.514690 (+ 28us) write_op.cc:435] Acquired schema lock
0503 07:58:42.514711 (+ 21us) tablet.cc:662] Decoding operations
0503 07:58:42.515159 (+ 448us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:42.515209 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:42.515231 (+ 22us) tablet.cc:685] Acquiring locks for 3 operations
0503 07:58:42.515514 (+ 283us) tablet.cc:701] Row locks acquired
0503 07:58:42.515529 (+ 15us) write_op.cc:260] PREPARE: finished
0503 07:58:42.515656 (+ 127us) write_op.cc:270] Start()
0503 07:58:42.515750 (+ 94us) write_op.cc:276] Timestamp: P: 1777795122515614 usec, L: 0
0503 07:58:42.515768 (+ 18us) op_driver.cc:348] REPLICATION: starting
0503 07:58:42.516274 (+ 506us) log.cc:844] Serialized 1299 byte log entry
0503 07:58:42.518617 (+ 2343us) op_driver.cc:464] REPLICATION: finished
0503 07:58:42.519068 (+ 451us) write_op.cc:301] APPLY: starting
0503 07:58:42.519130 (+ 62us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:42.519279 (+ 149us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:42.519375 (+ 96us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:42.519845 (+ 470us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:42.520026 (+ 181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0503 07:58:42.520084 (+ 58us) write_op.cc:312] APPLY: finished
0503 07:58:42.520292 (+ 208us) log.cc:844] Serialized 35 byte log entry
0503 07:58:42.520449 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:42.520546 (+ 97us) write_op.cc:454] Released schema lock
0503 07:58:42.520590 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:42.520905 (+ 315us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:42.520930 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57692,"reported_tablets":20,"spinlock_wait_cycles":631729536,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":1799,"apply.run_wall_time_us":1799,"num_ops":3,"prepare.queue_time_us":180,"prepare.run_cpu_time_us":2313,"prepare.run_wall_time_us":2313,"replication_time_us":2701}]]}
I20260503 07:58:42.556133 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.559165 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.559778 28034 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
W20260503 07:58:42.561056 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.546469 31176 raft_consensus.cc:493] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:42.561218 28034 raft_consensus.cc:1240] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:42.561580 31176 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:42.533073 31131 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260503 07:58:42.569752 31181 raft_consensus.cc:3055] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Stepping down as leader of term 4
I20260503 07:58:42.570122 31181 raft_consensus.cc:740] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:42.570950 31181 consensus_queue.cc:260] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.572335 31181 raft_consensus.cc:3060] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Advancing to term 5
I20260503 07:58:42.559630 27856 catalog_manager.cc:5671] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 4 to 6, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.574401 27856 catalog_manager.cc:5671] T a2c7e65c39c14ef9a8247a993905c0b6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 7 to 10, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 10 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.580056 27856 catalog_manager.cc:5671] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 7 to 8, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 8 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.582635 27856 catalog_manager.cc:5671] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 6, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.585417 27856 catalog_manager.cc:5671] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 8 to 9, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.589900 27856 catalog_manager.cc:5671] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.591197 27856 catalog_manager.cc:5671] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 6, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.592932 27856 catalog_manager.cc:5671] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.594659 27856 catalog_manager.cc:5671] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.595777 30842 raft_consensus.cc:515] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.596473 27856 catalog_manager.cc:5671] T 0bf3170afa5c43ddae7a0f830c5eb3dc P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.597623 30842 leader_election.cc:290] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:42.597820 27856 catalog_manager.cc:5671] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.599038 27856 catalog_manager.cc:5671] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 5 to 7, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 7 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.600477 27856 catalog_manager.cc:5671] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.602221 27856 catalog_manager.cc:5671] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 6 to 8, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 8 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:42.603667 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.626991 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:42.627437 28034 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:42.629616 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.630147 28100 raft_consensus.cc:3060] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 9
I20260503 07:58:42.630491 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.638479 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.641103 31172 raft_consensus.cc:515] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.642635 31172 leader_election.cc:290] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:42.647326 31176 raft_consensus.cc:515] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:42.648366 28030 raft_consensus.cc:2393] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:42.651858 28034 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 9.
I20260503 07:58:42.656354 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.652925 28585 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:42.658280 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.659571 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.660015 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.656759 28616 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:42.662231 31010 raft_consensus.cc:2804] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 9 FOLLOWER]: Leader election won for term 9
I20260503 07:58:42.662747 31010 raft_consensus.cc:697] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [term 9 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:42.663688 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.663552 31010 consensus_queue.cc:237] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.664295 31139 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:42.665446 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28731014d42b4316af0150b0e98f6152" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.666584 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.666819 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.668090 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.670874 28033 raft_consensus.cc:2393] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:42.670990 28100 raft_consensus.cc:2468] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 9.
I20260503 07:58:42.680238 28616 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:42.681496 30983 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:42.682901 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:42.683145 28073 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.683435 28034 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 6.
I20260503 07:58:42.660633 31176 leader_election.cc:290] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:42.662914 31175 raft_consensus.cc:515] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:42.686419 31175 leader_election.cc:290] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:42.702652 28105 raft_consensus.cc:1275] T d4a767f631d84b75af79d3964f3a548f P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260503 07:58:42.702868 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.705461 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.706375 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:42.707598 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.709232 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bf3170afa5c43ddae7a0f830c5eb3dc" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.710758 30983 consensus_queue.cc:1048] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:42.713006 28031 raft_consensus.cc:1275] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260503 07:58:42.716145 28028 raft_consensus.cc:2393] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 9: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:42.714069 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.719511 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:42.722525 28029 raft_consensus.cc:2393] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:42.723434 28029 raft_consensus.cc:1240] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:42.717283 28031 raft_consensus.cc:1275] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260503 07:58:42.719839 28034 raft_consensus.cc:2393] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:42.729813 28031 raft_consensus.cc:1240] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:42.731225 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2c7e65c39c14ef9a8247a993905c0b6" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.732220 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4029065128b84be9a45c0bfe2af75b6f" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.733512 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:42.734759 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.735694 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:42.736573 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.737545 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f44c930db4ede8aff2abe0206edef" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.738766 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.739959 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:42.741032 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:42.747316 28035 raft_consensus.cc:1275] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260503 07:58:42.754340 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.763935 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b81225f6fe134f46a66b68b7b1656ec5" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.770465 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.787160 27856 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33460 (request call id 317) took 1115 ms. Trace:
I20260503 07:58:42.787528 27856 rpcz_store.cc:276] 0503 07:58:41.665089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:41.665218 (+ 129us) service_pool.cc:224] Handling call
0503 07:58:42.770275 (+1105057us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0503 07:58:42.624010 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0503 07:58:42.624513 (+ 503us) write_op.cc:432] Acquiring schema lock in shared mode
0503 07:58:42.624540 (+ 27us) write_op.cc:435] Acquired schema lock
0503 07:58:42.624556 (+ 16us) tablet.cc:662] Decoding operations
0503 07:58:42.625674 (+ 1118us) write_op.cc:620] Acquiring the partition lock for write op
0503 07:58:42.625726 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0503 07:58:42.625750 (+ 24us) tablet.cc:685] Acquiring locks for 14 operations
0503 07:58:42.626897 (+ 1147us) tablet.cc:701] Row locks acquired
0503 07:58:42.626917 (+ 20us) write_op.cc:260] PREPARE: finished
0503 07:58:42.627022 (+ 105us) write_op.cc:270] Start()
0503 07:58:42.627112 (+ 90us) write_op.cc:276] Timestamp: P: 1777795122626985 usec, L: 0
0503 07:58:42.627132 (+ 20us) op_driver.cc:348] REPLICATION: starting
0503 07:58:42.656281 (+ 29149us) log.cc:844] Serialized 5492 byte log entry
0503 07:58:42.682793 (+ 26512us) op_driver.cc:464] REPLICATION: finished
0503 07:58:42.683195 (+ 402us) write_op.cc:301] APPLY: starting
0503 07:58:42.683266 (+ 71us) tablet.cc:1367] starting BulkCheckPresence
0503 07:58:42.683521 (+ 255us) tablet.cc:1370] finished BulkCheckPresence
0503 07:58:42.683606 (+ 85us) tablet.cc:1372] starting ApplyRowOperation cycle
0503 07:58:42.684861 (+ 1255us) tablet.cc:1383] finished ApplyRowOperation cycle
0503 07:58:42.685116 (+ 255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0503 07:58:42.685158 (+ 42us) write_op.cc:312] APPLY: finished
0503 07:58:42.685414 (+ 256us) log.cc:844] Serialized 101 byte log entry
0503 07:58:42.685544 (+ 130us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:42.685710 (+ 166us) write_op.cc:454] Released schema lock
0503 07:58:42.685759 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0503 07:58:42.686092 (+ 333us) write_op.cc:489] Releasing partition, row and schema locks
0503 07:58:42.686120 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":228,"apply.run_cpu_time_us":2845,"apply.run_wall_time_us":2845,"num_ops":14,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":4137,"prepare.run_wall_time_us":32515,"replication_time_us":55525}]]}
I20260503 07:58:42.798766 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.798931 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.802307 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:42.803077 28034 raft_consensus.cc:2393] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:42.804164 28035 raft_consensus.cc:2393] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 8: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:42.807379 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.817538 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.818549 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.823926 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55c91f6091bd409db505153a1d4c7531" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:42.824204 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.822985 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.830919 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:42.833284 28615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "426966c8fb5d49eea85d577d437e4252" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:42.839615 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.844457 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.845348 28032 raft_consensus.cc:1275] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260503 07:58:42.844270 27954 raft_consensus.cc:1217] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9] Dedup: 8.9->[]
I20260503 07:58:42.847795 27954 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260503 07:58:42.849563 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:42.851269 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.850525 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.855374 27959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40656d9e0b58422a98512c2de8445e60" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:42.857447 28618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:42.857559 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.859046 28621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:42.859593 28619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:42.866755 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.867362 28100 raft_consensus.cc:2368] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9.
I20260503 07:58:42.868613 28105 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11. Ops: []
I20260503 07:58:42.857650 28622 raft_consensus.cc:1217] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 9 LEADER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9] Dedup: 8.9->[]
I20260503 07:58:42.869655 28622 raft_consensus.cc:1240] T 28731014d42b4316af0150b0e98f6152 P 25017111886b42cfa5701a39de59b6ad [term 9 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260503 07:58:42.871627 27954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.875389 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48cbd9f468974e1db163ad369f5d7d11" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.876551 28103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.882951 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57291cbb014449748e69000cc57c9e10" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.885224 27953 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260503 07:58:42.882181 27854 catalog_manager.cc:5671] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.886858 27959 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260503 07:58:42.889514 27854 catalog_manager.cc:5671] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 8 to 9, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.892539 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc5427ec15974579a114f5b1955ebc27" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.893744 28032 raft_consensus.cc:1240] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:42.891449 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17885e062854b2d81dab3f3e9f8b08b" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.912854 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:42.916323 28622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5660140f2a4a67bee640fa37b03a74" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:42.918030 28101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:42.940639 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:42.943950 28622 raft_consensus.cc:2468] T fd5660140f2a4a67bee640fa37b03a74 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 5.
W20260503 07:58:42.947938 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:42.950147 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.4:46367, user_credentials={real_user=slave}} blocked reactor thread for 63420.3us
I20260503 07:58:42.921043 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:42.893426 31159 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
W20260503 07:58:42.956770 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260503 07:58:42.956121 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 43907.3us
I20260503 07:58:42.914440 27854 catalog_manager.cc:5671] T e7615e08909f47a2977e095a0e190c1e P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 7 to 9, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 9 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:42.970253 27854 catalog_manager.cc:5671] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:42.972482 27854 catalog_manager.cc:5671] T d4a767f631d84b75af79d3964f3a548f P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 5 to 6, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 6 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:42.978271 27854 catalog_manager.cc:5671] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:42.957631 31013 consensus_queue.cc:1059] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260503 07:58:42.980351 31130 consensus_queue.cc:1059] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260503 07:58:42.981675 27926 leader_election.cc:304] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:42.984970 27926 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:42.986399 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 108702us
I20260503 07:58:42.987172 27999 leader_election.cc:304] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:42.992702 27954 raft_consensus.cc:1275] T 9196b781b73d42de863558f5a560cce2 P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260503 07:58:42.995337 28104 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:42.998539 28615 raft_consensus.cc:2468] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 7.
I20260503 07:58:43.008417 30377 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:43.009919 30377 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.011534 30377 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:43.009500 31181 raft_consensus.cc:3055] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:43.015447 31181 raft_consensus.cc:740] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:42.986727 31126 raft_consensus.cc:2749] T 28731014d42b4316af0150b0e98f6152 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:43.016209 31181 consensus_queue.cc:260] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.017427 31181 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:42.998816 27926 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:42.989439 31144 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:43.020372 30990 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:43.020663 27926 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.021395 31142 raft_consensus.cc:3055] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:43.021750 31142 raft_consensus.cc:740] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:43.022461 31142 consensus_queue.cc:260] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:43.023741 31142 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:42.988240 31175 raft_consensus.cc:2749] T 971ac26c5f9841959a1801eb548b0ff0 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:42.998039 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.028005 30377 consensus_queue.cc:1048] T 9196b781b73d42de863558f5a560cce2 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260503 07:58:43.033702 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.034432 31176 raft_consensus.cc:2804] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:43.034778 31176 raft_consensus.cc:493] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:43.035113 31176 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
W20260503 07:58:43.037580 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 112064us
I20260503 07:58:43.044989 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:43.047906 28104 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260503 07:58:43.053905 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.037206 31059 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260503 07:58:43.047719 31175 raft_consensus.cc:2804] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:43.068796 30377 consensus_queue.cc:1048] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260503 07:58:43.070900 31176 raft_consensus.cc:515] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.071230 31172 raft_consensus.cc:2804] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:43.071627 31172 raft_consensus.cc:493] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:43.071977 31172 raft_consensus.cc:3060] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:43.081362 27999 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.068359 31059 raft_consensus.cc:493] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:43.074034 31175 raft_consensus.cc:493] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:43.093086 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.072906 31176 leader_election.cc:290] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:43.109336 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 81478.9us
I20260503 07:58:43.113948 27926 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:43.110301 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 96253.5us
I20260503 07:58:43.120982 27999 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:43.123670 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 122971us
I20260503 07:58:43.088609 31005 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260503 07:58:43.108721 31059 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:43.128943 27952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:43.135594 27952 raft_consensus.cc:606] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.131989 28075 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.139417 27999 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.121773 31175 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:43.147326 27926 leader_election.cc:304] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.128494 30990 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.128805 31167 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:43.131273 31144 raft_consensus.cc:2749] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:43.123487 31130 consensus_queue.cc:1048] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260503 07:58:43.141134 31153 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:43.149269 31020 raft_consensus.cc:3060] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:43.160136 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.144631 31204 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260503 07:58:43.166523 27956 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:43.152050 31005 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.162768 28613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad" is_pre_election: true
I20260503 07:58:43.154420 31142 consensus_queue.cc:1048] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260503 07:58:43.190999 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad
I20260503 07:58:43.167712 31204 raft_consensus.cc:493] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
W20260503 07:58:43.197435 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 50205.9us
I20260503 07:58:43.174180 31207 raft_consensus.cc:2749] T 0bf3170afa5c43ddae7a0f830c5eb3dc P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260503 07:58:43.162429 31167 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:43.201426 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:43.202132 27999 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.195120 28613 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
I20260503 07:58:43.180162 30983 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260503 07:58:43.192750 31153 raft_consensus.cc:2804] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:43.189777 31159 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:43.214041 31127 consensus_queue.cc:1059] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:43.220504 31172 raft_consensus.cc:515] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.232527 27926 leader_election.cc:304] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:43.232839 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 79087.7us
I20260503 07:58:43.232643 27999 leader_election.cc:304] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.204752 31005 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260503 07:58:43.201197 31204 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
W20260503 07:58:43.270272 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 122967us
I20260503 07:58:43.230859 31153 raft_consensus.cc:493] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:43.238862 31176 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260503 07:58:43.277552 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 45088.4us
I20260503 07:58:43.282246 27926 leader_election.cc:304] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.278017 31130 raft_consensus.cc:2749] T a2c7e65c39c14ef9a8247a993905c0b6 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:43.280815 27956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "648efe2729e74916af86a1421008e3c5"
dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:60658
I20260503 07:58:43.282246 28073 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.283427 27956 raft_consensus.cc:606] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:43.277663 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 45117.5us
I20260503 07:58:43.283995 30377 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260503 07:58:43.284412 30377 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:43.241432 31005 raft_consensus.cc:493] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25017111886b42cfa5701a39de59b6ad)
I20260503 07:58:43.284786 30377 raft_consensus.cc:3060] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 3 FOLLOWER]: Advancing to term 4
I20260503 07:58:43.276808 31153 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:43.238166 31159 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.298159 30377 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.286487 31005 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:43.301590 27926 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.290822 31176 raft_consensus.cc:2749] T 8a813d887a574b1f8a8be222ff2c07ae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:43.284945 31139 consensus_queue.cc:1059] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260503 07:58:43.306754 31126 raft_consensus.cc:993] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:43.292639 31130 raft_consensus.cc:2749] T 4029065128b84be9a45c0bfe2af75b6f P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:43.303917 30377 leader_election.cc:290] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:43.309959 31130 raft_consensus.cc:2749] T fd5660140f2a4a67bee640fa37b03a74 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:43.314006 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.317145 31176 raft_consensus.cc:2804] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260503 07:58:43.317510 31176 raft_consensus.cc:493] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:43.317857 31176 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Advancing to term 9
W20260503 07:58:43.320070 28585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 150564us
I20260503 07:58:43.321486 31167 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:43.324633 28583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 51362.9us
I20260503 07:58:43.327549 27999 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.331431 28030 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260503 07:58:43.324160 31211 raft_consensus.cc:1081] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:43.326253 31203 raft_consensus.cc:3055] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:43.335700 27999 leader_election.cc:304] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.338435 31159 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:43.340387 31131 raft_consensus.cc:3055] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:43.340791 31131 raft_consensus.cc:740] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:43.341600 31131 consensus_queue.cc:260] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.342730 31131 raft_consensus.cc:3060] T ba53ed3bde024b3898c35255fe29cdae P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:43.342558 31059 raft_consensus.cc:515] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.344056 31172 leader_election.cc:290] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.345219 27952 raft_consensus.cc:1240] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 6. Current term is 7. Ops: []
I20260503 07:58:43.350395 31020 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:43.350983 31203 raft_consensus.cc:740] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:43.351790 31203 consensus_queue.cc:260] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.352941 31203 raft_consensus.cc:3060] T cc5427ec15974579a114f5b1955ebc27 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:43.357394 31164 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260503 07:58:43.363328 31175 raft_consensus.cc:515] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.364274 27857 catalog_manager.cc:5671] T 9196b781b73d42de863558f5a560cce2 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 5 to 6, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 6 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } } }
I20260503 07:58:43.366029 27857 catalog_manager.cc:5671] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260503 07:58:43.375415 31153 raft_consensus.cc:515] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:43.376581 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 75009.3us
I20260503 07:58:43.381624 27926 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.382678 27926 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.387616 31211 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260503 07:58:43.391650 31005 raft_consensus.cc:515] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.393658 31005 leader_election.cc:290] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Requested vote from peers be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643), 25017111886b42cfa5701a39de59b6ad (127.26.42.4:46367)
I20260503 07:58:43.396297 27926 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:43.400789 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 65158.4us
I20260503 07:58:43.401638 27999 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.334389 31216 raft_consensus.cc:2804] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:43.411470 27926 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.387979 31153 leader_election.cc:290] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.404309 27856 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 11 to 12, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3), now has a pending config: VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1), VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2), VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 12 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:43.397493 31175 leader_election.cc:290] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.399947 31211 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:43.415068 31142 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P 37e72845941344c9b0aaa7235a6f4473 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:43.410326 31216 raft_consensus.cc:493] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:43.407516 31005 raft_consensus.cc:2749] T eec1cba8286a4c81a9f66d33c805d337 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:43.415848 30983 raft_consensus.cc:2749] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:43.417858 31172 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election won for term 9
W20260503 07:58:43.426759 28075 leader_election.cc:336] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.629s (SENT)
I20260503 07:58:43.432142 28075 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.443838 27956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.444505 27956 raft_consensus.cc:2393] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 4: Already voted for candidate 37e72845941344c9b0aaa7235a6f4473 in this term.
I20260503 07:58:43.445817 31202 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:43.430310 31216 raft_consensus.cc:3060] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:43.447346 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
W20260503 07:58:43.449441 28075 leader_election.cc:336] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.630s (SENT)
I20260503 07:58:43.449465 27960 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 12.
I20260503 07:58:43.449905 28075 leader_election.cc:304] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.450747 27926 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.453856 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:43.454373 27952 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:43.454689 27926 leader_election.cc:304] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.456664 30377 consensus_queue.cc:1059] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260503 07:58:43.458375 28075 leader_election.cc:336] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.635s (SENT)
I20260503 07:58:43.458709 28075 leader_election.cc:304] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.459406 31219 consensus_queue.cc:1048] T 0a30bfd95aae43cd8f0fb4113f4b5452 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260503 07:58:43.462848 31201 raft_consensus.cc:3055] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Stepping down as leader of term 6
I20260503 07:58:43.463220 31201 raft_consensus.cc:740] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:43.463833 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904abdfb5f89462c8a674a30012ffef3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:43.463946 31201 consensus_queue.cc:260] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.439628 31176 raft_consensus.cc:515] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.467074 31176 leader_election.cc:290] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:43.469172 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:43.470399 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:43.472414 31143 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260503 07:58:43.472783 31143 raft_consensus.cc:493] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:43.474025 31143 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:43.474557 31059 leader_election.cc:290] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.476140 30983 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.477663 31020 raft_consensus.cc:2955] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 12 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:43.486933 27926 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.491494 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.493754 30377 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.481863 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473; no voters:
I20260503 07:58:43.480216 31139 raft_consensus.cc:2749] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:43.504398 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:43.510270 31013 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:43.510691 31013 raft_consensus.cc:493] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:43.511016 31013 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:43.514035 27952 raft_consensus.cc:2955] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:43.514614 31216 raft_consensus.cc:515] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.515225 31143 raft_consensus.cc:515] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.516471 31216 leader_election.cc:290] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.495070 31127 raft_consensus.cc:2749] T b81225f6fe134f46a66b68b7b1656ec5 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.504911 28106 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 7.
I20260503 07:58:43.520331 28107 raft_consensus.cc:1275] T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260503 07:58:43.494678 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 70235.4us
I20260503 07:58:43.499203 27855 catalog_manager.cc:5671] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
W20260503 07:58:43.522697 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 64324.2us
W20260503 07:58:43.523361 28075 leader_election.cc:336] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.638s (SENT)
I20260503 07:58:43.523844 28075 leader_election.cc:304] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.500020 31201 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:43.526700 27999 leader_election.cc:400] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9.
I20260503 07:58:43.516876 31143 leader_election.cc:290] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:43.540723 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.545118 27955 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:43.544476 27999 leader_election.cc:403] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260503 07:58:43.519490 28616 raft_consensus.cc:2468] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 4.
W20260503 07:58:43.547545 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 60667.9us
I20260503 07:58:43.522387 31172 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [term 9 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:43.546321 31219 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.547624 31175 raft_consensus.cc:2749] T 9376e27fcb734be296a0612be76962b1 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643) with higher term. Message: Invalid argument: T 9376e27fcb734be296a0612be76962b1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate adaf84b6ac60420ab03d39b9db9f0413 for earlier term 8. Current term is 9.
I20260503 07:58:43.539892 31202 raft_consensus.cc:2749] T 0a30bfd95aae43cd8f0fb4113f4b5452 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:43.570425 27999 leader_election.cc:304] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:43.494747 31005 raft_consensus.cc:2955] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:43.571714 27955 raft_consensus.cc:2468] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 13.
I20260503 07:58:43.571496 28073 leader_election.cc:304] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:43.575438 28030 raft_consensus.cc:1240] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Rejecting Update request from peer 25017111886b42cfa5701a39de59b6ad for earlier term 5. Current term is 6. Ops: []
I20260503 07:58:43.575088 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.578809 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba53ed3bde024b3898c35255fe29cdae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.579818 28033 raft_consensus.cc:2393] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 in current term 6: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:43.579818 28029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.581694 28073 leader_election.cc:304] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:43.583928 28075 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:43.576140 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9376e27fcb734be296a0612be76962b1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.584681 28029 raft_consensus.cc:2368] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8.
I20260503 07:58:43.585407 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdf8a9cd6734a8ea93c12c8fcee5bd5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.585706 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a30bfd95aae43cd8f0fb4113f4b5452" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.586303 28032 raft_consensus.cc:2468] T 0a30bfd95aae43cd8f0fb4113f4b5452 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:43.586565 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:43.587208 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.587399 30377 raft_consensus.cc:2804] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Leader election won for term 13
I20260503 07:58:43.587567 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.587863 30377 raft_consensus.cc:697] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 13 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:43.589506 28032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.585996 28026 raft_consensus.cc:2468] T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:43.589425 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ae6a5bb3434187bcd46baf182a3cfd" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:43.589874 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.585943 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.592571 27955 raft_consensus.cc:1240] T 16ae6a5bb3434187bcd46baf182a3cfd P 37e72845941344c9b0aaa7235a6f4473 [term 11 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 10. Current term is 11. Ops: []
I20260503 07:58:43.593680 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.592942 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:43.596366 28030 raft_consensus.cc:2376] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 7. Re-sending same reply.
I20260503 07:58:43.597247 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.579967 31143 raft_consensus.cc:2804] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260503 07:58:43.598798 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04054c4bfe6478ca043dee547359d4e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.598975 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.591166 30377 consensus_queue.cc:237] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.598129 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a77e35309a36413d8eaa064760e0e7ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.571636 31175 consensus_queue.cc:1059] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260503 07:58:43.600122 31221 raft_consensus.cc:2804] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:43.603825 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.603910 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.604713 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.602496 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90fb5d680ff149d8a9e1a217eb1877be" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.606613 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.594234 31130 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:43.610847 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa70a5c46ac143db96b5fa56b70d4170" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:43.606878 28075 leader_election.cc:336] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.571s (SENT)
I20260503 07:58:43.613688 28075 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.586254 31212 consensus_queue.cc:1048] T 9376e27fcb734be296a0612be76962b1 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260503 07:58:43.621775 31223 raft_consensus.cc:3055] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Stepping down as leader of term 10
I20260503 07:58:43.622164 31223 raft_consensus.cc:740] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:43.622967 31223 consensus_queue.cc:260] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.624291 31223 raft_consensus.cc:3060] T 16ae6a5bb3434187bcd46baf182a3cfd P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:43.610075 31172 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.626334 31204 raft_consensus.cc:515] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.611150 31221 raft_consensus.cc:697] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:43.628319 31204 leader_election.cc:290] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:43.628005 31221 consensus_queue.cc:237] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.628947 28105 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 10. Current term is 11. Ops: []
I20260503 07:58:43.607798 31143 raft_consensus.cc:697] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [term 4 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:43.649698 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.646492 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.605443 31206 consensus_queue.cc:1059] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260503 07:58:43.676157 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:43.677896 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 71049.3us
W20260503 07:58:43.681449 28075 leader_election.cc:336] T 0ecd0742bf5f466c8b6faa8b8c6708af P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.761s (SENT)
W20260503 07:58:43.682528 28000 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:43.603333 31013 raft_consensus.cc:515] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.692766 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.656980 31216 raft_consensus.cc:493] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be26cebb7c90445ea9a74f66463457c1)
I20260503 07:58:43.700784 28030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.644774 31126 consensus_queue.cc:1059] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260503 07:58:43.679075 31202 raft_consensus.cc:2749] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:43.704172 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b75e8de5b4f4852a6c586b0a4bf99ba" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
W20260503 07:58:43.704986 28075 leader_election.cc:336] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.797s (SENT)
I20260503 07:58:43.630740 31130 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.714509 28075 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.701649 31216 raft_consensus.cc:515] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.721863 31216 leader_election.cc:290] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.736723 28028 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:43.726351 31204 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P be26cebb7c90445ea9a74f66463457c1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260503 07:58:43.749738 31181 raft_consensus.cc:3055] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Stepping down as leader of term 5
I20260503 07:58:43.750236 28026 raft_consensus.cc:1240] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260503 07:58:43.750236 31181 raft_consensus.cc:740] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:43.751860 31181 consensus_queue.cc:260] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.753952 28028 raft_consensus.cc:1240] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 11. Current term is 12. Ops: []
I20260503 07:58:43.755414 28108 raft_consensus.cc:2468] T efcad53159b446a285a0bdf1f53a426e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:43.757613 30983 raft_consensus.cc:3055] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Stepping down as leader of term 10
I20260503 07:58:43.757994 31181 raft_consensus.cc:3060] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 5 FOLLOWER]: Advancing to term 6
I20260503 07:58:43.758131 30983 raft_consensus.cc:740] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:43.759222 30983 consensus_queue.cc:260] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.760597 30983 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:43.731927 31143 consensus_queue.cc:237] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.777086 31130 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.789458 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.789949 28105 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:43.800760 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f94961272bf04c3789c23577f7fec5eb" candidate_uuid: "25017111886b42cfa5701a39de59b6ad" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.801481 27960 raft_consensus.cc:3060] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:43.806212 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:43.806725 28107 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:43.807979 27924 leader_election.cc:304] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
W20260503 07:58:43.813993 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:43.782671 31013 leader_election.cc:290] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:43.827078 27924 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:43.829059 28105 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 8.
I20260503 07:58:43.831740 28583 leader_election.cc:304] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:43.817474 31127 raft_consensus.cc:2804] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader election won for term 7
I20260503 07:58:43.840921 31070 raft_consensus.cc:2804] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:43.849752 31070 raft_consensus.cc:697] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [term 8 LEADER]: Becoming Leader. State: Replica: 25017111886b42cfa5701a39de59b6ad, State: Running, Role: LEADER
I20260503 07:58:43.850579 31070 consensus_queue.cc:237] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:43.854313 28026 raft_consensus.cc:1240] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260503 07:58:43.854766 28027 raft_consensus.cc:1240] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:43.855690 28035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:43.839514 31142 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260503 07:58:43.856702 27926 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.860684 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdf11186a1e4eb99758f417d61dfd7a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:43.861196 28100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecd0742bf5f466c8b6faa8b8c6708af" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:43.857474 28032 raft_consensus.cc:1240] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:43.859380 27856 catalog_manager.cc:5671] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 6 to 7, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 7 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260503 07:58:43.861938 28075 leader_election.cc:336] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375): Timed out: RequestConsensusVote RPC to 127.26.42.2:41375 timed out after 1.819s (SENT)
I20260503 07:58:43.862357 27856 catalog_manager.cc:5671] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 7 to 9, leader changed from 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 9 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:43.864025 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.865250 27960 raft_consensus.cc:2468] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25017111886b42cfa5701a39de59b6ad in term 8.
I20260503 07:58:43.862341 28075 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.865586 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.866971 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.869329 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.874130 27926 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.875213 27926 leader_election.cc:304] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.875308 28108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.876451 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.876753 28026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e28b4630c47646428fe7dd12f35f482a" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:43.878768 28075 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.882354 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:43.884382 28075 leader_election.cc:304] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.860713 31127 raft_consensus.cc:697] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:43.887848 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:43.887848 28027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107c0bcfce95420b89dc8b6dd201c7e9" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:43.888688 28027 raft_consensus.cc:3060] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:43.889232 31059 raft_consensus.cc:2749] T 55c91f6091bd409db505153a1d4c7531 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.868709 31130 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:43.889801 31059 consensus_queue.cc:1048] T 0ecd0742bf5f466c8b6faa8b8c6708af P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:43.890343 31130 raft_consensus.cc:993] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:43.890736 31130 raft_consensus.cc:1081] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:43.893963 28616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "836271c3803e4270aeffc67aeb7df764" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25017111886b42cfa5701a39de59b6ad"
I20260503 07:58:43.894372 31159 raft_consensus.cc:2749] T 16ae6a5bb3434187bcd46baf182a3cfd P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260503 07:58:43.894629 31139 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.895032 28027 raft_consensus.cc:2468] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 11.
I20260503 07:58:43.895444 28075 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
W20260503 07:58:43.897567 28072 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:43.897254 28075 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.865083 31142 raft_consensus.cc:493] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:43.906558 28075 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.906944 28100 raft_consensus.cc:1240] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [term 12 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 11. Current term is 12. Ops: []
I20260503 07:58:43.902493 31139 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:43.895928 31144 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
W20260503 07:58:43.918171 27998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:43.921283 27999 leader_election.cc:304] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:43.927711 31227 log.cc:927] Time spent T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.131s user 0.001s sys 0.000s
I20260503 07:58:43.953066 27999 leader_election.cc:304] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters:
I20260503 07:58:43.870293 31005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43616 (request call id 7) took 7232 ms. Trace:
I20260503 07:58:43.920639 27854 catalog_manager.cc:5671] T bcdf11186a1e4eb99758f417d61dfd7a P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: config changed from index -1 to 8, no longer has a pending config: VOTER 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1), VOTER adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2), VOTER be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 12 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } }
I20260503 07:58:43.954466 27999 leader_election.cc:304] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.895771 31154 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260503 07:58:43.957734 28075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 51241.7us
I20260503 07:58:43.958389 28075 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.902359 31204 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:43.964000 28075 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.965112 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.966693 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343a411e92a3469597c429025bfd0ba3" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.967304 27952 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 12. Current term is 13. Ops: []
I20260503 07:58:43.968081 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5dcd66021442aa07a617dd72b8b56" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.948796 31142 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:43.968633 28075 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.968910 30377 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:43.971766 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a24a4ca75146cb8eb7f1b028582c15" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.972055 30377 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:43.971735 28075 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.952214 31143 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P be26cebb7c90445ea9a74f66463457c1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:43.973476 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ab306b1af74c9ab53cebf8986a9e48" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:43.973366 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fcd5bb1bc2480dbe59f5e131874dd1" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.960105 31175 raft_consensus.cc:2749] T c9d2b513dd664ccfbfcbd9f74fe0dddf P adaf84b6ac60420ab03d39b9db9f0413 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260503 07:58:43.962095 31172 raft_consensus.cc:2804] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader election won for term 5
I20260503 07:58:43.982944 27957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fc4931efc2a444c9fa25ec21c056196" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.983371 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc81e80292a4d5d9d661ff8d092c006" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:43.989085 30377 raft_consensus.cc:2749] T 836271c3803e4270aeffc67aeb7df764 P be26cebb7c90445ea9a74f66463457c1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:43.888688 31127 consensus_queue.cc:237] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.970355 31176 raft_consensus.cc:2749] T ba53ed3bde024b3898c35255fe29cdae P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260503 07:58:44.001238 27999 leader_election.cc:304] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:43.988248 31221 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:44.005548 31221 raft_consensus.cc:2749] T 0ecd0742bf5f466c8b6faa8b8c6708af P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.009910 31143 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:44.010309 31143 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.011456 31143 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:43.997145 28075 leader_election.cc:304] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:43.967919 31139 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:44.023147 30377 raft_consensus.cc:2749] T a77e35309a36413d8eaa064760e0e7ba P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:44.023509 28075 leader_election.cc:304] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.024798 28075 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.027376 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:44.027961 27958 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 9.
I20260503 07:58:44.028883 28073 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:43.999341 31172 raft_consensus.cc:697] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:44.030946 27999 leader_election.cc:304] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.038772 28075 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.041802 27999 leader_election.cc:304] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.045873 31201 raft_consensus.cc:2749] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260503 07:58:44.045814 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 94159.7us
I20260503 07:58:44.046471 27999 leader_election.cc:304] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.047664 28075 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.048303 31175 raft_consensus.cc:2749] T 40656d9e0b58422a98512c2de8445e60 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:44.048419 31201 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260503 07:58:44.049386 27999 leader_election.cc:304] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.049463 28075 leader_election.cc:304] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.050236 31201 raft_consensus.cc:2749] T 5b75e8de5b4f4852a6c586b0a4bf99ba P be26cebb7c90445ea9a74f66463457c1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:44.052265 28613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2b5d5b5c52e455ca768d69be2c3e744"
dest_uuid: "25017111886b42cfa5701a39de59b6ad"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:40520
I20260503 07:58:44.052805 28613 raft_consensus.cc:606] T c2b5d5b5c52e455ca768d69be2c3e744 P 25017111886b42cfa5701a39de59b6ad [term 7 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.027508 31204 raft_consensus.cc:2749] T fa70a5c46ac143db96b5fa56b70d4170 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260503 07:58:44.028833 31154 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.062690 31142 raft_consensus.cc:515] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:43.955317 31005 rpcz_store.cc:276] 0503 07:58:36.612124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0503 07:58:36.613086 (+ 962us) service_pool.cc:224] Handling call
0503 07:58:36.737765 (+124679us) log.cc:844] Serialized 431 byte log entry
0503 07:58:40.299935 (+3562170us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b540013b3a0. stack: 00007f8501654c83 00007f8501654b80 00007f8500fa2574 00007f850ac7d6b4 00007f850ac7d649 00007f850468d951 00007f850469d522 00007f850467e28a 00007f8504685133 00007f85046850b9 00007f8504685049 00007f8504685011 00007f85046841dd 0000000000379254 0000000000379099 00007f8501686ab5
0503 07:58:43.840106 (+3540171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18910,"raft.queue_time_us":822966,"raft.run_cpu_time_us":41865,"raft.run_wall_time_us":2338147,"spinlock_wait_cycles":55845120,"thread_start_us":548761,"threads_started":2,"wal-append.queue_time_us":315935,"wal-append.run_cpu_time_us":25186,"wal-append.run_wall_time_us":2136470}
I20260503 07:58:44.066246 28031 raft_consensus.cc:3055] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 LEADER]: Stepping down as leader of term 11
I20260503 07:58:44.066562 28031 raft_consensus.cc:740] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:44.067303 28031 consensus_queue.cc:260] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } attrs { replace: false } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.068140 28031 raft_consensus.cc:3060] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:44.039759 31139 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260503 07:58:44.069749 31139 raft_consensus.cc:493] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260503 07:58:44.070072 31139 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:44.074123 27999 leader_election.cc:304] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.075690 28031 raft_consensus.cc:1275] T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260503 07:58:44.045078 31216 raft_consensus.cc:2749] T 8a1831fdfd114170b082b1c55dd3dd50 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260503 07:58:44.079507 27905 auto_rebalancer.cc:814] Could not move replica: Incomplete: tablet bcdf11186a1e4eb99758f417d61dfd7a, TS 37e72845941344c9b0aaa7235a6f4473 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
W20260503 07:58:44.079919 27905 auto_rebalancer.cc:295] scheduled replica move failed to complete: Incomplete: tablet bcdf11186a1e4eb99758f417d61dfd7a, TS 37e72845941344c9b0aaa7235a6f4473 -> TS 25017111886b42cfa5701a39de59b6ad move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.064998 31172 consensus_queue.cc:237] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:44.081769 27857 catalog_manager.cc:5671] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 12 to 13, leader changed from adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 13 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260503 07:58:44.054075 31176 raft_consensus.cc:2749] T d17885e062854b2d81dab3f3e9f8b08b P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260503 07:58:44.083582 27857 catalog_manager.cc:5671] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 reported cstate change: term changed from 3 to 4, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to be26cebb7c90445ea9a74f66463457c1 (127.26.42.3). New cstate: current_term: 4 leader_uuid: "be26cebb7c90445ea9a74f66463457c1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:44.073381 31175 raft_consensus.cc:2749] T cc5427ec15974579a114f5b1955ebc27 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.092430 27999 leader_election.cc:304] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.098560 27999 leader_election.cc:304] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.099181 28616 raft_consensus.cc:2468] T 836271c3803e4270aeffc67aeb7df764 P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 6.
I20260503 07:58:44.080641 31154 consensus_queue.cc:1059] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260503 07:58:44.101665 31154 raft_consensus.cc:3055] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:44.102006 31154 raft_consensus.cc:740] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:44.089398 31216 raft_consensus.cc:2749] T 57291cbb014449748e69000cc57c9e10 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.102787 31154 consensus_queue.cc:260] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.089272 31204 consensus_queue.cc:1059] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260503 07:58:44.104004 31154 raft_consensus.cc:3060] T 90fb5d680ff149d8a9e1a217eb1877be P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.104578 30377 raft_consensus.cc:3055] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 11 LEADER]: Stepping down as leader of term 11
I20260503 07:58:44.104930 30377 raft_consensus.cc:740] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:44.105523 30377 consensus_queue.cc:260] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.089330 31223 raft_consensus.cc:493] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:44.107059 31223 raft_consensus.cc:515] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.108682 31223 leader_election.cc:290] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:44.106647 30377 raft_consensus.cc:3060] T d17885e062854b2d81dab3f3e9f8b08b P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Advancing to term 12
I20260503 07:58:44.113876 31005 raft_consensus.cc:2749] T 48cbd9f468974e1db163ad369f5d7d11 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:44.114315 27999 leader_election.cc:304] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.115343 27999 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 25017111886b42cfa5701a39de59b6ad, 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:44.116086 31221 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.116577 31221 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260503 07:58:44.114460 31005 raft_consensus.cc:2749] T e04054c4bfe6478ca043dee547359d4e P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260503 07:58:44.122632 31233 log.cc:927] Time spent T bcdf11186a1e4eb99758f417d61dfd7a P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.174s user 0.000s sys 0.002s
I20260503 07:58:44.095762 31142 leader_election.cc:290] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Requested vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:44.126829 31144 raft_consensus.cc:2749] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.128398 27960 raft_consensus.cc:1240] T 90fb5d680ff149d8a9e1a217eb1877be P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Rejecting Update request from peer be26cebb7c90445ea9a74f66463457c1 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:44.136670 28615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9d2b513dd664ccfbfcbd9f74fe0dddf"
dest_uuid: "25017111886b42cfa5701a39de59b6ad"
mode: GRACEFUL
new_leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:40520
I20260503 07:58:44.137198 28615 raft_consensus.cc:606] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Received request to transfer leadership to TS adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.144862 28106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:44.146226 28106 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.144433 27958 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P 37e72845941344c9b0aaa7235a6f4473 [term 13 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260503 07:58:44.140476 31139 raft_consensus.cc:515] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.147886 28615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4a767f631d84b75af79d3964f3a548f"
dest_uuid: "25017111886b42cfa5701a39de59b6ad"
mode: GRACEFUL
new_leader_uuid: "be26cebb7c90445ea9a74f66463457c1"
from {username='slave'} at 127.0.0.1:40520
I20260503 07:58:44.141217 31201 consensus_queue.cc:1059] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260503 07:58:44.148418 28615 raft_consensus.cc:606] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Received request to transfer leadership to TS be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.148608 31139 leader_election.cc:290] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375)
I20260503 07:58:44.148797 28615 raft_consensus.cc:614] T d4a767f631d84b75af79d3964f3a548f P 25017111886b42cfa5701a39de59b6ad [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260503 07:58:44.149061 31201 raft_consensus.cc:3055] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:44.149523 31201 raft_consensus.cc:740] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:44.150132 26792 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260503 07:58:44.150485 31201 consensus_queue.cc:260] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.152171 31201 raft_consensus.cc:3060] T e04054c4bfe6478ca043dee547359d4e P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
W20260503 07:58:44.153167 27926 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:44.158476 27960 consensus_queue.cc:237] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.163730 28106 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:44.134743 31143 consensus_queue.cc:1059] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260503 07:58:44.165758 31204 raft_consensus.cc:3055] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:44.166244 31204 raft_consensus.cc:740] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:44.167163 31204 consensus_queue.cc:260] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.168663 31204 raft_consensus.cc:3060] T 48cbd9f468974e1db163ad369f5d7d11 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:44.177877 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:44.178395 27958 raft_consensus.cc:3060] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:44.185501 31143 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260503 07:58:44.189211 27958 raft_consensus.cc:2468] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be26cebb7c90445ea9a74f66463457c1 in term 10.
I20260503 07:58:44.191336 26792 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260503 07:58:44.192107 26792 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260503 07:58:44.197456 27854 catalog_manager.cc:5671] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "25017111886b42cfa5701a39de59b6ad" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260503 07:58:44.206521 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 91225.1us
I20260503 07:58:44.209928 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd4f1f94ce446d19045339767e2f84a" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:44.210762 28031 raft_consensus.cc:2393] T 7bd4f1f94ce446d19045339767e2f84a P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37e72845941344c9b0aaa7235a6f4473 in current term 7: Already voted for candidate adaf84b6ac60420ab03d39b9db9f0413 in this term.
I20260503 07:58:44.221242 28073 leader_election.cc:304] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:44.222312 28033 raft_consensus.cc:1240] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:44.222402 28028 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:44.216558 27856 catalog_manager.cc:5671] T efcad53159b446a285a0bdf1f53a426e P 37e72845941344c9b0aaa7235a6f4473 reported cstate change: term changed from 6 to 7, leader changed from be26cebb7c90445ea9a74f66463457c1 (127.26.42.3) to 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1). New cstate: current_term: 7 leader_uuid: "37e72845941344c9b0aaa7235a6f4473" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:44.228641 28033 raft_consensus.cc:1240] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 10. Current term is 11. Ops: []
I20260503 07:58:44.230321 28027 raft_consensus.cc:1240] T 107c0bcfce95420b89dc8b6dd201c7e9 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260503 07:58:44.230693 27924 leader_election.cc:304] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:44.231567 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efcad53159b446a285a0bdf1f53a426e" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:44.235910 28033 raft_consensus.cc:1240] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:44.227416 31159 raft_consensus.cc:2804] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Leader election won for term 10
I20260503 07:58:44.222676 31242 raft_consensus.cc:493] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:44.227507 31005 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:44.239413 31005 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.241299 31005 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:44.244530 28028 raft_consensus.cc:1275] T 5c3f44c930db4ede8aff2abe0206edef P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260503 07:58:44.236717 31239 raft_consensus.cc:2804] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:44.246521 31005 raft_consensus.cc:493] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 37e72845941344c9b0aaa7235a6f4473)
I20260503 07:58:44.246873 31239 raft_consensus.cc:697] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Leader. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:44.247061 31005 raft_consensus.cc:515] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.248497 28028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:44.249122 28028 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 7.
I20260503 07:58:44.247679 28616 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 25017111886b42cfa5701a39de59b6ad [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:44.222153 31172 consensus_queue.cc:1059] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260503 07:58:44.238684 28031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:44.257094 28031 raft_consensus.cc:493] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:44.257519 28031 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.254649 28033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "648efe2729e74916af86a1421008e3c5"
dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
from {username='slave'} at 127.0.0.1:33288
I20260503 07:58:44.258121 28033 raft_consensus.cc:493] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260503 07:58:44.258513 28033 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:44.247682 31239 consensus_queue.cc:237] T 1aee73f7040c418fa1ef15f9d8b84c3c P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.271374 28026 raft_consensus.cc:1240] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 8. Current term is 9. Ops: []
I20260503 07:58:44.281793 28031 raft_consensus.cc:515] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.283288 28031 leader_election.cc:290] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:44.284354 28033 raft_consensus.cc:515] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.287779 31204 consensus_queue.cc:1059] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260503 07:58:44.289678 28034 raft_consensus.cc:1240] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:44.289853 28031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aee73f7040c418fa1ef15f9d8b84c3c" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:44.290346 28031 raft_consensus.cc:3060] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.254390 31159 raft_consensus.cc:697] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 10 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:44.298416 28033 leader_election.cc:290] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Requested vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:44.305619 28102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:44.308950 27952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:44.309934 28075 leader_election.cc:304] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters: 37e72845941344c9b0aaa7235a6f4473
I20260503 07:58:44.310825 30377 raft_consensus.cc:2804] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election won for term 11
I20260503 07:58:44.311406 30377 raft_consensus.cc:697] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [term 11 LEADER]: Becoming Leader. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
I20260503 07:58:44.311530 28107 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260503 07:58:44.288975 31204 raft_consensus.cc:3055] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:44.315727 27926 leader_election.cc:304] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37e72845941344c9b0aaa7235a6f4473; no voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413
I20260503 07:58:44.317813 28104 raft_consensus.cc:1240] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [term 13 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 12. Current term is 13. Ops: []
I20260503 07:58:44.293290 31223 raft_consensus.cc:3055] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 12 LEADER]: Stepping down as leader of term 12
I20260503 07:58:44.319543 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98c37994a7bf4429b4fff0b9cf211dec" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:44.247969 31242 raft_consensus.cc:515] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.322346 28107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:44.328408 28107 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.322817 30377 consensus_queue.cc:237] T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.330184 27999 leader_election.cc:304] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.331712 27999 leader_election.cc:304] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.332885 31175 raft_consensus.cc:2749] T 1fc4931efc2a444c9fa25ec21c056196 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260503 07:58:44.333597 31175 raft_consensus.cc:2749] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.333998 27999 leader_election.cc:304] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.336057 28107 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:44.325678 28033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413" is_pre_election: true
I20260503 07:58:44.325142 28031 raft_consensus.cc:2468] T 1aee73f7040c418fa1ef15f9d8b84c3c P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37e72845941344c9b0aaa7235a6f4473 in term 8.
I20260503 07:58:44.336728 31176 raft_consensus.cc:2749] T 05a24a4ca75146cb8eb7f1b028582c15 P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260503 07:58:44.336184 27999 leader_election.cc:304] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:44.336514 28001 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:44.338058 31176 raft_consensus.cc:2749] T 71fcd5bb1bc2480dbe59f5e131874dd1 P adaf84b6ac60420ab03d39b9db9f0413 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260503 07:58:44.339129 27999 leader_election.cc:304] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.339854 31176 raft_consensus.cc:2749] T 343a411e92a3469597c429025bfd0ba3 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260503 07:58:44.340147 27999 leader_election.cc:304] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.340962 31176 raft_consensus.cc:2749] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.346531 27958 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260503 07:58:44.323537 31223 raft_consensus.cc:740] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:44.348073 27999 leader_election.cc:304] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.348253 31223 consensus_queue.cc:260] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.329936 31131 consensus_queue.cc:1059] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260503 07:58:44.327672 28034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b30e1a1065f4cd298949319438c2dae" candidate_uuid: "be26cebb7c90445ea9a74f66463457c1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "adaf84b6ac60420ab03d39b9db9f0413"
I20260503 07:58:44.315474 31204 raft_consensus.cc:740] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be26cebb7c90445ea9a74f66463457c1, State: Running, Role: LEADER
W20260503 07:58:44.362051 28073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.1:34525, user_credentials={real_user=slave}} blocked reactor thread for 48769.8us
I20260503 07:58:44.312747 31154 consensus_queue.cc:1048] T 904abdfb5f89462c8a674a30012ffef3 P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260503 07:58:44.358009 30842 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260503 07:58:44.357262 31240 raft_consensus.cc:3060] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:44.324769 31203 consensus_queue.cc:1048] T bcdf11186a1e4eb99758f417d61dfd7a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260503 07:58:44.356408 31005 leader_election.cc:290] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:44.357406 31175 raft_consensus.cc:2749] T a2ab306b1af74c9ab53cebf8986a9e48 P adaf84b6ac60420ab03d39b9db9f0413 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260503 07:58:44.359215 31219 consensus_queue.cc:1059] T 343a411e92a3469597c429025bfd0ba3 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260503 07:58:44.380764 28107 raft_consensus.cc:1275] T cbc81e80292a4d5d9d661ff8d092c006 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260503 07:58:44.363602 31176 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260503 07:58:44.394364 28105 raft_consensus.cc:1275] T f94961272bf04c3789c23577f7fec5eb P be26cebb7c90445ea9a74f66463457c1 [term 8 FOLLOWER]: Refusing update from remote peer 25017111886b42cfa5701a39de59b6ad: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260503 07:58:44.404452 27999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 54432.6us
I20260503 07:58:44.399026 31159 consensus_queue.cc:237] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.431533 28613 raft_consensus.cc:1275] T 426966c8fb5d49eea85d577d437e4252 P 25017111886b42cfa5701a39de59b6ad [term 7 FOLLOWER]: Refusing update from remote peer adaf84b6ac60420ab03d39b9db9f0413: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260503 07:58:44.431775 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:44.362679 31223 raft_consensus.cc:3060] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 12 FOLLOWER]: Advancing to term 13
I20260503 07:58:44.432535 31176 raft_consensus.cc:2804] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Leader election won for term 8
I20260503 07:58:44.433204 31176 raft_consensus.cc:697] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:44.433995 31176 consensus_queue.cc:237] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.437717 31204 consensus_queue.cc:260] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.439097 31204 raft_consensus.cc:3060] T 57291cbb014449748e69000cc57c9e10 P be26cebb7c90445ea9a74f66463457c1 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.432555 31181 consensus_queue.cc:1048] T f94961272bf04c3789c23577f7fec5eb P 25017111886b42cfa5701a39de59b6ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260503 07:58:44.328624 31214 consensus_queue.cc:1059] T 71fcd5bb1bc2480dbe59f5e131874dd1 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260503 07:58:44.432654 27999 leader_election.cc:304] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25017111886b42cfa5701a39de59b6ad, adaf84b6ac60420ab03d39b9db9f0413; no voters: be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:44.444561 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 89122.7us
I20260503 07:58:44.458542 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "be26cebb7c90445ea9a74f66463457c1"
I20260503 07:58:44.459056 28105 raft_consensus.cc:3060] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 10 FOLLOWER]: Advancing to term 11
I20260503 07:58:44.461380 28104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:44.490242 28105 raft_consensus.cc:2468] T 648efe2729e74916af86a1421008e3c5 P be26cebb7c90445ea9a74f66463457c1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 11.
I20260503 07:58:44.491262 27999 leader_election.cc:304] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413, be26cebb7c90445ea9a74f66463457c1; no voters:
I20260503 07:58:44.457075 31175 raft_consensus.cc:2804] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Leader election won for term 6
I20260503 07:58:44.474967 31127 consensus_queue.cc:1048] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260503 07:58:44.493929 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 48701.5us
I20260503 07:58:44.501613 31130 consensus_queue.cc:1048] T 5c3f44c930db4ede8aff2abe0206edef P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:44.503170 31130 consensus_queue.cc:1059] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260503 07:58:44.504330 31130 raft_consensus.cc:3055] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Stepping down as leader of term 8
I20260503 07:58:44.504624 31130 raft_consensus.cc:740] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:44.505945 28035 raft_consensus.cc:1275] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260503 07:58:44.506263 28035 pending_rounds.cc:85] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Aborting all ops after (but not including) 6
I20260503 07:58:44.506462 28035 pending_rounds.cc:107] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260503 07:58:44.506656 28035 raft_consensus.cc:2889] T e28b4630c47646428fe7dd12f35f482a P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260503 07:58:44.507064 27855 catalog_manager.cc:5671] T fd5660140f2a4a67bee640fa37b03a74 P adaf84b6ac60420ab03d39b9db9f0413 reported cstate change: term changed from 4 to 5, leader changed from 25017111886b42cfa5701a39de59b6ad (127.26.42.4) to adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2). New cstate: current_term: 5 leader_uuid: "adaf84b6ac60420ab03d39b9db9f0413" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260503 07:58:44.508224 31240 raft_consensus.cc:2749] T 7bd4f1f94ce446d19045339767e2f84a P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260503 07:58:44.454389 30983 consensus_queue.cc:1059] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260503 07:58:44.509601 30983 raft_consensus.cc:3055] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Stepping down as leader of term 9
I20260503 07:58:44.496663 31059 raft_consensus.cc:3055] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:44.509925 30983 raft_consensus.cc:740] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:44.510216 31059 raft_consensus.cc:740] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:44.514659 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1" is_pre_election: true
I20260503 07:58:44.517330 27999 leader_election.cc:304] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.511003 31242 leader_election.cc:290] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 37e72845941344c9b0aaa7235a6f4473 (127.26.42.1:34525), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
I20260503 07:58:44.512939 31175 raft_consensus.cc:697] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [term 6 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:44.477829 31244 consensus_queue.cc:1048] T 426966c8fb5d49eea85d577d437e4252 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260503 07:58:44.519026 31130 consensus_queue.cc:260] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.519255 31175 consensus_queue.cc:237] T 836271c3803e4270aeffc67aeb7df764 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
I20260503 07:58:44.496819 31216 raft_consensus.cc:2804] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader election won for term 11
I20260503 07:58:44.520172 31130 raft_consensus.cc:3060] T 05a24a4ca75146cb8eb7f1b028582c15 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Advancing to term 9
I20260503 07:58:44.524202 28028 raft_consensus.cc:1240] T cbc81e80292a4d5d9d661ff8d092c006 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
W20260503 07:58:44.521786 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 125874us
I20260503 07:58:44.535779 28034 raft_consensus.cc:1240] T 35e5dcd66021442aa07a617dd72b8b56 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 FOLLOWER]: Rejecting Update request from peer 37e72845941344c9b0aaa7235a6f4473 for earlier term 7. Current term is 8. Ops: []
I20260503 07:58:44.528067 31244 raft_consensus.cc:2749] T 98c37994a7bf4429b4fff0b9cf211dec P adaf84b6ac60420ab03d39b9db9f0413 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260503 07:58:44.548805 27958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:44.554519 27958 raft_consensus.cc:3055] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:44.554788 27958 raft_consensus.cc:740] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:44.551419 27951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648efe2729e74916af86a1421008e3c5" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "37e72845941344c9b0aaa7235a6f4473"
I20260503 07:58:44.555969 27951 raft_consensus.cc:3055] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Stepping down as leader of term 10
I20260503 07:58:44.556243 27951 raft_consensus.cc:740] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:44.551986 27956 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P 37e72845941344c9b0aaa7235a6f4473 [term 10 FOLLOWER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:44.553013 27953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3757a05a49e489386cdbf85d2f8e970" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:44.553876 27955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7615e08909f47a2977e095a0e190c1e" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:44.557682 27960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "334bd7ff8fab4298882aa7841ab084e6" candidate_uuid: "adaf84b6ac60420ab03d39b9db9f0413" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "37e72845941344c9b0aaa7235a6f4473" is_pre_election: true
I20260503 07:58:44.571739 27951 consensus_queue.cc:260] T 648efe2729e74916af86a1421008e3c5 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.555377 27958 consensus_queue.cc:260] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.542596 31216 raft_consensus.cc:697] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [term 11 LEADER]: Becoming Leader. State: Replica: adaf84b6ac60420ab03d39b9db9f0413, State: Running, Role: LEADER
I20260503 07:58:44.551141 31240 raft_consensus.cc:493] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:44.529104 31203 consensus_queue.cc:1048] T e28b4630c47646428fe7dd12f35f482a P be26cebb7c90445ea9a74f66463457c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260503 07:58:44.594342 27958 raft_consensus.cc:3060] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.624926 27958 raft_consensus.cc:2468] T 334bd7ff8fab4298882aa7841ab084e6 P 37e72845941344c9b0aaa7235a6f4473 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adaf84b6ac60420ab03d39b9db9f0413 in term 8.
I20260503 07:58:44.534272 30983 consensus_queue.cc:260] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.649991 28108 raft_consensus.cc:1240] T 3b30e1a1065f4cd298949319438c2dae P be26cebb7c90445ea9a74f66463457c1 [term 10 LEADER]: Rejecting Update request from peer adaf84b6ac60420ab03d39b9db9f0413 for earlier term 9. Current term is 10. Ops: []
I20260503 07:58:44.555105 31059 consensus_queue.cc:260] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.594106 31131 consensus_queue.cc:1059] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
W20260503 07:58:44.661780 31253 log.cc:927] Time spent T 107c0bcfce95420b89dc8b6dd201c7e9 P be26cebb7c90445ea9a74f66463457c1: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
W20260503 07:58:44.667496 27926 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.2:41375, user_credentials={real_user=slave}} blocked reactor thread for 87244.2us
I20260503 07:58:44.594290 31240 raft_consensus.cc:515] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "25017111886b42cfa5701a39de59b6ad" member_type: VOTER last_known_addr { host: "127.26.42.4" port: 46367 } attrs { promote: false } }
W20260503 07:58:44.659013 31246 log.cc:927] Time spent T 8cdf8a9cd6734a8ea93c12c8fcee5bd5 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.193s user 0.000s sys 0.001s
I20260503 07:58:44.670171 27999 leader_election.cc:304] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
W20260503 07:58:44.679081 27924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.42.3:45643, user_credentials={real_user=slave}} blocked reactor thread for 100589us
I20260503 07:58:44.683109 27999 leader_election.cc:304] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.684428 28034 raft_consensus.cc:3060] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 6 FOLLOWER]: Advancing to term 7
I20260503 07:58:44.684924 27999 leader_election.cc:304] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adaf84b6ac60420ab03d39b9db9f0413; no voters: 37e72845941344c9b0aaa7235a6f4473, be26cebb7c90445ea9a74f66463457c1
I20260503 07:58:44.684026 31223 raft_consensus.cc:2749] T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260503 07:58:44.670575 30983 raft_consensus.cc:3060] T 1fc4931efc2a444c9fa25ec21c056196 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Advancing to term 10
I20260503 07:58:44.660653 31214 consensus_queue.cc:1059] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260503 07:58:44.685329 31242 raft_consensus.cc:2749] T 334bd7ff8fab4298882aa7841ab084e6 P adaf84b6ac60420ab03d39b9db9f0413 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260503 07:58:44.702666 27952 raft_consensus.cc:1275] T 904abdfb5f89462c8a674a30012ffef3 P 37e72845941344c9b0aaa7235a6f4473 [term 4 FOLLOWER]: Refusing update from remote peer be26cebb7c90445ea9a74f66463457c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260503 07:58:44.688011 31172 raft_consensus.cc:2749] T e7615e08909f47a2977e095a0e190c1e P adaf84b6ac60420ab03d39b9db9f0413 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260503 07:58:44.678282 31005 consensus_queue.cc:1059] T 3b30e1a1065f4cd298949319438c2dae P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260503 07:58:44.710227 27924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260503 07:58:44.670607 31216 consensus_queue.cc:237] T 648efe2729e74916af86a1421008e3c5 P adaf84b6ac60420ab03d39b9db9f0413 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.730264 28034 raft_consensus.cc:1275] T efcad53159b446a285a0bdf1f53a426e P adaf84b6ac60420ab03d39b9db9f0413 [term 7 FOLLOWER]: Refusing update from remote peer 37e72845941344c9b0aaa7235a6f4473: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260503 07:58:44.745287 31059 raft_consensus.cc:3060] T 35e5dcd66021442aa07a617dd72b8b56 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.749150 31126 raft_consensus.cc:3055] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Stepping down as leader of term 7
I20260503 07:58:44.749508 31126 raft_consensus.cc:740] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 37e72845941344c9b0aaa7235a6f4473, State: Running, Role: LEADER
I20260503 07:58:44.731381 31144 raft_consensus.cc:493] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260503 07:58:44.750150 31144 raft_consensus.cc:515] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } } peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } }
I20260503 07:58:44.750214 31126 consensus_queue.cc:260] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "37e72845941344c9b0aaa7235a6f4473" member_type: VOTER last_known_addr { host: "127.26.42.1" port: 34525 } } peers { permanent_uuid: "adaf84b6ac60420ab03d39b9db9f0413" member_type: VOTER last_known_addr { host: "127.26.42.2" port: 41375 } attrs { replace: false } } peers { permanent_uuid: "be26cebb7c90445ea9a74f66463457c1" member_type: VOTER last_known_addr { host: "127.26.42.3" port: 45643 } }
I20260503 07:58:44.751379 31126 raft_consensus.cc:3060] T cbc81e80292a4d5d9d661ff8d092c006 P 37e72845941344c9b0aaa7235a6f4473 [term 7 FOLLOWER]: Advancing to term 8
I20260503 07:58:44.752224 31144 leader_election.cc:290] T 8a1831fdfd114170b082b1c55dd3dd50 P 37e72845941344c9b0aaa7235a6f4473 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers adaf84b6ac60420ab03d39b9db9f0413 (127.26.42.2:41375), be26cebb7c90445ea9a74f66463457c1 (127.26.42.3:45643)
W20260503 07:58:44.754901 31255 log.cc:927] Time spent T c3757a05a49e489386cdbf85d2f8e970 P adaf84b6ac60420ab03d39b9db9f0413: Append to log took a long time: real 0.118s user 0.000s sys 0.001s
I20260503 07:58:44.758598 31269 raft_consensus.cc:993] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad: : Instructing follower adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:44.759032 31269 raft_consensus.cc:1081] T c9d2b513dd664ccfbfcbd9f74fe0dddf P 25017111886b42cfa5701a39de59b6ad [term 4 LEADER]: Signalling peer adaf84b6ac60420ab03d39b9db9f0413 to start an election
I20260503 07:58:44.763239 28105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1831fdfd114170b082b1c55dd3dd50" candidate_uuid: "37e72845941344c9b0aaa7235a6f4473" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be26cebb7c90445ea9a74f66463457c1"